Nov 06 21:09:31 devstack cinder-volume[76284]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:09:31 devstack cinder-volume[76284]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:09:31 devstack cinder-volume[76284]: we strongly recommend against using it for new projects. Nov 06 21:09:31 devstack cinder-volume[76284]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:09:31 devstack cinder-volume[76284]: framework. For more detail see Nov 06 21:09:31 devstack cinder-volume[76284]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:09:31 devstack cinder-volume[76284]: import eventlet # noqa Nov 06 21:09:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:09:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:09:34 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:09:35 devstack cinder-volume[76284]: INFO dbcounter [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Registered counter for database cinder Nov 06 21:09:35 devstack cinder-volume[76284]: DEBUG oslo_db.sqlalchemy.engines [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76284) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:35 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writer thread running {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:09:35 devstack cinder-volume[76284]: INFO cinder.rpc [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:09:35 devstack cinder-volume[76284]: INFO cinder.rpc [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:09:35 devstack cinder-volume[76284]: DEBUG oslo_db.sqlalchemy.engines [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76284) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:35 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Determined volume DB was empty at startup. Nov 06 21:09:35 devstack cinder-volume[76284]: DEBUG cinder.volume.manager [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76284) __init__ /opt/stack/cinder/cinder/volume/manager.py:293}} Nov 06 21:09:35 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:09:35 devstack cinder-volume[76284]: WARNING stevedore.named [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:09:35 devstack cinder-volume[76284]: WARNING castellan.key_manager [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:09:35 devstack cinder-volume[76284]: WARNING cinder.keymgr.conf_key_mgr [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:09:35 devstack cinder-volume[76284]: DEBUG cinder.volume.drivers.lvm [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76284) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 21:09:35 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_concurrency.processutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.492s {{(pid=76284) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_db.sqlalchemy.engines [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76284) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:36 devstack cinder-volume[76284]: INFO cinder.rpc [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 21:09:36 devstack cinder-volume[76284]: INFO cinder.rpc [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 21:09:36 devstack cinder-volume[76284]: WARNING stevedore.named [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:09:36 devstack cinder-volume[76284]: WARNING castellan.key_manager [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:09:36 devstack cinder-volume[76284]: INFO cinder.volume.manager [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_db.sqlalchemy.engines [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76284) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:36 devstack cinder-volume[76284]: INFO oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Starting 1 workers Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Started child 76435 {{(pid=76284) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Full set of CONF: {{(pid=76284) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:09:36 devstack cinder-volume[76435]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] ******************************************************************************** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Configuration options gathered from: {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] ================================================================================ {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] allow_availability_zone_fallback = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] allow_compression_on_image_upload = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] allowed_direct_url_schemes = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] api_rate_limit = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] auth_strategy = keystone {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] az_cache_duration = 3600 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_availability_zone = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_host = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_stats_polling_interval = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backup_api_class = cinder.backup.api.API {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backup_name_template = backup-%s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backup_use_same_host = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backup_use_temp_snapshot = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] chap_password = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] chap_username = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_internal_tenant_project_id = c4e6d1fa4bf542adba95016212eaa465 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_internal_tenant_user_id = 18b2558bf21e4bfe94cac1e84cb594c8 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cloned_volume_same_az = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cluster = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] compression_format = gzip {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] compute_api_class = cinder.compute.nova.API {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] config_dir = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] config_source = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] control_exchange = openstack {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] debug = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] default_availability_zone = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] default_group_type = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] default_volume_type = lvmdriver-1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] disk_geometry = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] driver_client_cert = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] driver_client_cert_key = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] driver_data_namespace = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] driver_ssl_cert_path = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] driver_ssl_cert_verify = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] driver_use_ssl = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] enable_force_upload = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76435]: INFO cinder.volume.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] enable_new_services = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] enable_unsupported_driver = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] enforce_multipath_for_image_xfer = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] filter_function = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_api_insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_api_servers = ['http://192.168.122.92/image'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_api_ssl_compression = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_ca_certificates_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_catalog_info = image:glance:publicURL {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_num_retries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance_request_timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] goodness_function = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] graceful_shutdown_timeout = 5 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] group_api_class = cinder.group.api.API {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] host = devstack {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_compress_on_upload = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_conversion_address_space_limit = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_conversion_cpu_limit = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_conversion_disable = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_introspection_address_space_limit = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_introspection_cpu_limit = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_upload_use_cinder_backend = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_upload_use_internal_tenant = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_volume_cache_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_volume_cache_max_count = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] image_volume_cache_max_size_gb = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] init_host_max_objects_retrieval = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] instance_format = [instance: %(uuid)s] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] iscsi_target_flags = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] iscsi_write_cache = on {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] iser_helper = tgtadm {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] iser_ip_address = 192.168.122.92 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] iser_port = 3260 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_color = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_config_append = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_dir = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_options = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_rotate_interval = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_rotate_interval_type = days {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] log_rotation_type = none {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] max_age = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] max_logfile_count = 30 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] max_logfile_size_mb = 200 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] max_over_subscription_ratio = 20.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] message_reap_interval = 86400 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] message_ttl = 2592000 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] migration_create_volume_timeout_secs = 300 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] monkey_patch = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] monkey_patch_modules = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] my_ip = 192.168.122.92 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] no_snapshot_gb_quota = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] num_iser_scan_tries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] num_shell_tries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] num_volume_device_scan_tries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] nvmeof_conn_info_version = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] nvmet_ns_id = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] nvmet_port_id = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_max_limit = 1000 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_volume_ext_list = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_volume_listen_port = 8776 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_volume_use_ssl = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] osapi_volume_workers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] per_volume_size_limit = -1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] periodic_fuzzy_delay = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] periodic_interval = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] public_endpoint = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] publish_errors = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_backup_gigabytes = 1000 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_backups = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_gigabytes = 1000 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_groups = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_snapshots = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] quota_volumes = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] rate_limit_burst = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] rate_limit_except_level = CRITICAL {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] rate_limit_interval = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] reinit_driver_count = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] replication_device = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] report_discard_supported = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] report_interval = 120 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] reservation_clean_interval = 86400 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] reservation_expire = 86400 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] reserved_image_namespaces = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] reserved_percentage = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] rpc_response_timeout = 120 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] run_external_periodic_tasks = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] scst_target_driver = iscsi {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] scst_target_iqn_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_down_time = 720 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] shell_completion = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] snapshot_name_template = snapshot-%s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] snapshot_same_host = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] split_loggers = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] state_path = /opt/stack/data/cinder {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] storage_availability_zone = nova {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] storage_protocol = iSCSI {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] syslog_log_facility = LOG_USER {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] target_helper = lioadm {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] target_ip_address = 192.168.122.92 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] target_port = 3260 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] target_protocol = iscsi {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] target_secondary_ip_addresses = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] trace_flags = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] transport_url = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] until_refresh = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_chap_auth = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_default_quota_class = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_journal = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_json = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_multipath_for_image_xfer = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_stderr = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] use_syslog = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] verify_glance_signatures = enabled {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_api_class = cinder.volume.api.API {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_backend_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_clear = zero {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_clear_ionice = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_clear_size = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_copy_bps_limit = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_dd_blocksize = 1M {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_name_template = volume-%s {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_service_inithost_offload = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volume_usage_audit_period = month {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] zoning_mode = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_concurrency.disable_process_locking = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.auth_section = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.auth_type = password {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.auth_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.cache = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.include_service_catalog = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.interface = public {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_password = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcache_username = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.region_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.service_type = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.92/identity {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.backend = dogpile.cache.null {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.backend_argument = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.backend_expiration_time = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.config_prefix = cache.oslo {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.debug_cache_backend = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.enable_retry_client = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.enable_socket_keepalive = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.expiration_time = 600 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.hashclient_retry_attempts = 2 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_dead_retry = 300 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_pool_maxsize = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_sasl_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.password = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.proxies = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.redis_db = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.redis_server = localhost:6379 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.retry_attempts = 2 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.retry_delay = 0.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.socket_keepalive_count = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.socket_keepalive_idle = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.socket_keepalive_interval = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.socket_timeout = 1.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.tls_allowed_ciphers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.tls_cafile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.tls_certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.tls_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.tls_keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cache.username = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] coordination.backend_url = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.asyncio_connection = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.asyncio_slave_connection = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.backend = sqlalchemy {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.connection = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.connection_debug = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.connection_parameters = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.connection_recycle_time = 3600 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.connection_trace = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.db_inc_retry_interval = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.db_max_retries = 20 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.db_max_retry_interval = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.db_retry_interval = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.max_overflow = 50 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.max_pool_size = 5 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.max_retries = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.mysql_wsrep_sync_wait = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.pool_timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.retry_interval = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.slave_connection = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.sqlite_synchronous = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.synchronous_reader = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] database.use_db_reconnect = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_tracing.insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack sudo[76466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.connection_string = messaging:// {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack sudo[76466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.es_doc_type = notification {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.es_scroll_size = 10000 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.es_scroll_time = 2m {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.filter_error_trace = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.hmac_keys = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.sentinel_service_name = mymaster {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.socket_timeout = 0.1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.trace_requests = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler.trace_sqlalchemy = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler_jaeger.process_tags = {} {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler_jaeger.service_name_prefix = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] profiler_otlp.service_name_prefix = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.enforce_new_defaults = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.policy_default_rule = default {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.policy_file = policy.yaml {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.group = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.helper_command = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] privsep_osbrick.user = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.group = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.helper_command = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] cinder_sys_admin.user = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.auth_section = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.auth_type = password {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.cafile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.collect_timing = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.send_service_user_token = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.split_loggers = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.tls_ciphers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] service_user.tls_min_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.auth_section = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.auth_type = password {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.collect_timing = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.region_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.split_loggers = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.tls_ciphers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] glance.tls_min_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.backend_availability_zone = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.chap_password = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.chap_username = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.disk_geometry = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.driver_client_cert = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.driver_client_cert_key = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.driver_data_namespace = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.driver_use_ssl = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.extra_capabilities = {} {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.filter_function = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.goodness_function = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.iscsi_target_flags = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.iscsi_write_cache = on {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.iser_helper = tgtadm {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.iser_ip_address = 192.168.122.92 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.iser_port = 3260 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.lvm_share_target = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.lvm_type = auto {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.num_shell_tries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.replication_device = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.report_discard_supported = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.reserved_percentage = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.target_helper = tgtadm {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.target_ip_address = 192.168.122.92 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.target_port = 3260 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.target_protocol = iscsi {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.trace_flags = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.unique_fqdn_network = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.use_chap_auth = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_backend_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_clear = zero {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_clear_ionice = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_clear_size = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_reports.file_event_handler = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_reports.log_dir = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.backend_host = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.chap_password = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.chap_username = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.disk_geometry = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.driver_client_cert = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.extra_capabilities = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.filter_function = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.goodness_function = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.iser_helper = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.iser_ip_address = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.iser_port = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.lvm_share_target = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.lvm_type = auto {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.num_shell_tries = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.replication_device = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.report_discard_supported = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.reserved_percentage = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.scst_target_driver = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.storage_protocol = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.target_helper = lioadm {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.target_ip_address = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.target_port = 3260 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.trace_flags = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.use_chap_auth = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_clear = zero {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_clear_size = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] lvmdriver-1.volumes_dir = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_notifications.driver = [] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_notifications.retry = -1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] key_manager.fixed_key = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.barbican_api_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.barbican_endpoint = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.barbican_endpoint_type = public {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.barbican_region_name = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.cafile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.collect_timing = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.number_of_retries = 60 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.retry_delay = 1 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.send_service_user_token = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.split_loggers = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.tls_ciphers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.tls_min_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.verify_ssl = True {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican.verify_ssl_path = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.auth_section = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.auth_type = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.cafile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.certfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.collect_timing = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.insecure = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.keyfile = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.split_loggers = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.timeout = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.tls_ciphers = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] barbican_service_user.tls_min_version = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.approle_role_id = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.approle_secret_id = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.auth_method = approle {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.auth_path = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.kv_mountpoint = secret {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.kv_path = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.kv_version = 2 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.namespace = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.root_token_id = **** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.ssl_ca_crt_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.timeout = 60.0 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.token_file = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.token_role = None {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.use_ssl = False {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:09:36 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] ******************************************************************************** {{(pid=76284) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:09:37 devstack sudo[76466]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:37 devstack sudo[76577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:37 devstack sudo[76577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:37 devstack sudo[76577]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.261s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:09:37 devstack cinder-volume[76435]: INFO cinder.brick.local_dev.lvm [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:37 devstack sudo[76668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:37 devstack sudo[76668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:37 devstack sudo[76668]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG cinder.brick.local_dev.lvm [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76435) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 21:09:37 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:37 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:37 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:38 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:38 devstack sudo[76926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:38 devstack sudo[76926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:38 devstack sudo[76926]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:38 devstack sudo[77046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 21:09:38 devstack sudo[77046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:38 devstack sudo[77046]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.266s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:38 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:38 devstack sudo[77049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:38 devstack sudo[77049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:39 devstack sudo[77049]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:39 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:39 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:39 devstack sudo[77134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:39 devstack sudo[77134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:39 devstack sudo[77134]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:39 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:39 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:39 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:39 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:39 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:39 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:39 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:39 devstack sudo[77171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:39 devstack sudo[77171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:40 devstack sudo[77171]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:40 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:40 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:40 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:40 devstack cinder-volume[76435]: INFO cinder.volume.drivers.lvm [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:40 devstack sudo[77235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:40 devstack sudo[77235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:40 devstack sudo[77235]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:40 devstack sudo[77244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:40 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:40 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:40 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:40 devstack sudo[77247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:40 devstack sudo[77247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:41 devstack sudo[77247]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:41 devstack sudo[77250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:41 devstack sudo[77250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:41 devstack sudo[77250]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:41 devstack sudo[77253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:41 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:41 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:41 devstack cinder-volume[76435]: INFO cinder.volume.driver [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG cinder.volume.driver [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76435) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_db.sqlalchemy.engines [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writer thread running {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG cinder.db.api [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Building query based on filter {{(pid=76435) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG cinder.image.image_utils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76435) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:09:41 devstack cinder-volume[76435]: INFO cinder.keymgr.migration [None req-b32d057d-5011-4675-9062-2bf4071e934c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:09:41 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:41 devstack sudo[77257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:41 devstack sudo[77257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:42 devstack sudo[77257]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:42 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:42 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:42 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:42 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:42 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:42 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:42 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:42 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:42 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG cinder.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Notifying Schedulers of capabilities ... {{(pid=76435) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:09:42 devstack cinder-volume[76435]: INFO cinder.volume.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Driver initialization completed successfully. Nov 06 21:09:42 devstack cinder-volume[76435]: INFO cinder.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Initiating service 2 cleanup Nov 06 21:09:42 devstack cinder-volume[76435]: INFO cinder.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Service 2 cleanup completed. Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG cinder.service [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Creating RPC server for service cinder-volume {{(pid=76435) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG cinder.service [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76435) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:09:42 devstack cinder-volume[76435]: INFO cinder.volume.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:09:42 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:43 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:09:43 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:43 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:43 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:43 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:43 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:43 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:43 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:43 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:43 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:43 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:09:43 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:43 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:43 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:43 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:09:43 devstack sudo[77285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:09:43 devstack sudo[77285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:09:44 devstack sudo[77285]: pam_unix(sudo:session): session closed for user root Nov 06 21:09:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:09:44 devstack cinder-volume[76435]: INFO cinder.volume.manager [None req-a3b36fba-70a3-40e4-8fb6-4f7b00b857d8 None None] Driver post RPC initialization completed successfully. Nov 06 21:09:44 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager._thread_info {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:09:44 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread count: 6 {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:09:44 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread info: [<_MainThread(MainThread, started 129344070709376)>, , , , , ] {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:09:46 devstack cinder-volume[76284]: DEBUG dbcounter [-] [76284] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76284) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:09:54 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writing DB stats cinder:SELECT=3 {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:09:54 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:44 devstack sudo[79239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:10:44 devstack sudo[79239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:44 devstack sudo[79239]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:44 devstack sudo[79249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:10:44 devstack sudo[79249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:44 devstack sudo[79249]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:44 devstack sudo[79252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:10:44 devstack sudo[79252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:44 devstack sudo[79252]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:10:44 devstack sudo[79261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:10:44 devstack sudo[79261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:10:45 devstack sudo[79261]: pam_unix(sudo:session): session closed for user root Nov 06 21:10:45 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:10:45 devstack cinder-volume[76435]: DEBUG cinder.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Notifying Schedulers of capabilities ... {{(pid=76435) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:10:45 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager._thread_info {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:10:45 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread count: 6 {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:10:45 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread info: [<_MainThread(MainThread, started 129344070709376)>, , , , , ] {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:44 devstack sudo[82635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:11:44 devstack sudo[82635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:44 devstack sudo[82635]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:44 devstack sudo[82642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:11:44 devstack sudo[82642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:44 devstack sudo[82642]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:44 devstack sudo[82648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:11:44 devstack sudo[82648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:44 devstack sudo[82648]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:11:44 devstack sudo[82657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:11:44 devstack sudo[82657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:11:45 devstack sudo[82657]: pam_unix(sudo:session): session closed for user root Nov 06 21:11:45 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:11:45 devstack cinder-volume[76435]: DEBUG cinder.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Notifying Schedulers of capabilities ... {{(pid=76435) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:11:54 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writing DB stats cinder:SELECT=1 {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:11:54 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writing DB stats cinder:UPDATE=1 {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:44 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:12:44 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:44 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:44 devstack sudo[84807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:12:44 devstack sudo[84807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:44 devstack sudo[84807]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:44 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:12:44 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:44 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:12:44 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:12:44 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:12:45 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Nov 06 21:12:45 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:12:45 devstack cinder-volume[76435]: DEBUG cinder.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Notifying Schedulers of capabilities ... {{(pid=76435) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:12:45 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager._thread_info {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:12:45 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread count: 6 {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:12:45 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread info: [<_MainThread(MainThread, started 129344070709376)>, , , , , ] {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG cinder.volume.drivers.lvm [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Updating volume stats {{(pid=76435) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:44 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:13:44 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:44 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:44 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:13:44 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:44 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:44 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:13:44 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:44 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:44 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:13:44 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:13:44 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:13:45 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Nov 06 21:13:45 devstack cinder-volume[76435]: DEBUG oslo_concurrency.processutils [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76435) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:13:45 devstack cinder-volume[76435]: DEBUG cinder.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Notifying Schedulers of capabilities ... {{(pid=76435) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:13:45 devstack cinder-volume[76435]: DEBUG oslo_service.periodic_task [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] Running periodic task VolumeManager._thread_info {{(pid=76435) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:13:45 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread count: 6 {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:13:45 devstack cinder-volume[76435]: DEBUG cinder.volume.manager [None req-60318254-af6a-455d-bb71-c22daa8ee609 None None] thread info: [<_MainThread(MainThread, started 129344070709376)>, , , , , ] {{(pid=76435) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:13:54 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writing DB stats cinder:SELECT=1 {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:13:54 devstack cinder-volume[76435]: DEBUG dbcounter [-] [76435] Writing DB stats cinder:UPDATE=1 {{(pid=76435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:13:55 devstack cinder-volume[76284]: INFO oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Caught SIGTERM, stopping children Nov 06 21:13:55 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Acquiring lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:13:55 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Acquired lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:13:55 devstack cinder-volume[76284]: DEBUG oslo_concurrency.lockutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Releasing lock "singleton_lock" {{(pid=76284) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:13:55 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Stop services. {{(pid=76284) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:13:55 devstack cinder-volume[76284]: DEBUG oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Killing children. {{(pid=76284) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:13:55 devstack cinder-volume[76284]: INFO oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Waiting on 1 children to exit Nov 06 21:13:57 devstack cinder-volume[76435]: DEBUG oslo_concurrency.lockutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Acquiring lock "singleton_lock" {{(pid=76435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:13:57 devstack cinder-volume[76435]: DEBUG oslo_concurrency.lockutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Acquired lock "singleton_lock" {{(pid=76435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:13:57 devstack cinder-volume[76435]: DEBUG oslo_concurrency.lockutils [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Releasing lock "singleton_lock" {{(pid=76435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:13:57 devstack cinder-volume[76435]: WARNING amqp [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:13:57 devstack cinder-volume[76435]: WARNING amqp [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:13:58 devstack cinder-volume[76284]: INFO oslo_service.backend._eventlet.service [None req-9abcf245-1037-404e-b2d2-c848e88ffaf1 None None] Child 76435 exited with status 0 Nov 06 21:13:58 devstack cinder-volume[86493]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:13:58 devstack cinder-volume[86493]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:13:58 devstack cinder-volume[86493]: we strongly recommend against using it for new projects. Nov 06 21:13:58 devstack cinder-volume[86493]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:13:58 devstack cinder-volume[86493]: framework. For more detail see Nov 06 21:13:58 devstack cinder-volume[86493]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:13:58 devstack cinder-volume[86493]: import eventlet # noqa Nov 06 21:14:00 devstack cinder-volume[86493]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:00 devstack cinder-volume[86493]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:00 devstack cinder-volume[86493]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:01 devstack cinder-volume[86493]: INFO dbcounter [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Registered counter for database cinder Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_db.sqlalchemy.engines [None req-282f728a-1433-4429-8360-3aee96178c47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG dbcounter [-] [86493] Writer thread running {{(pid=86493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:01 devstack cinder-volume[86493]: INFO cinder.rpc [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:14:01 devstack cinder-volume[86493]: INFO cinder.rpc [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_db.sqlalchemy.engines [None req-282f728a-1433-4429-8360-3aee96178c47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:01 devstack cinder-volume[86493]: INFO cinder.volume.manager [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Determined volume DB was empty at startup. Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG cinder.volume.manager [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86493) __init__ /opt/stack/cinder/cinder/volume/manager.py:293}} Nov 06 21:14:01 devstack cinder-volume[86493]: INFO cinder.volume.manager [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:14:01 devstack cinder-volume[86493]: WARNING stevedore.named [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:01 devstack cinder-volume[86493]: WARNING castellan.key_manager [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:01 devstack cinder-volume[86493]: WARNING cinder.keymgr.conf_key_mgr [None req-282f728a-1433-4429-8360-3aee96178c47 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:01 devstack cinder-volume[86493]: INFO cinder.volume.manager [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_db.sqlalchemy.engines [None req-282f728a-1433-4429-8360-3aee96178c47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:01 devstack cinder-volume[86493]: INFO oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Starting 1 workers Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Started child 86712 {{(pid=86493) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Full set of CONF: {{(pid=86493) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] ******************************************************************************** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Configuration options gathered from: {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] ================================================================================ {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] allow_availability_zone_fallback = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] allow_compression_on_image_upload = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] allowed_direct_url_schemes = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] api_rate_limit = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] auth_strategy = keystone {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_availability_zone = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_host = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_stats_polling_interval = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backup_api_class = cinder.backup.api.API {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backup_name_template = backup-%s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backup_use_same_host = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backup_use_temp_snapshot = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] chap_password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86712]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] chap_username = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_internal_tenant_project_id = c4e6d1fa4bf542adba95016212eaa465 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_internal_tenant_user_id = 18b2558bf21e4bfe94cac1e84cb594c8 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cluster = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] compression_format = gzip {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] compute_api_class = cinder.compute.nova.API {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] config_dir = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] config_source = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] control_exchange = openstack {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] debug = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] default_availability_zone = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] default_group_type = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] default_volume_type = QuobyteHD {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] disk_geometry = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] driver_client_cert = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] driver_client_cert_key = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] driver_data_namespace = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] driver_ssl_cert_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] driver_ssl_cert_verify = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] driver_use_ssl = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] enable_new_services = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] enable_unsupported_driver = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] enabled_backends = ['QuobyteHD'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] enforce_multipath_for_image_xfer = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] filter_function = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_api_insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_api_servers = ['http://192.168.122.92/image'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_api_ssl_compression = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_ca_certificates_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_catalog_info = image:glance:publicURL {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_num_retries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance_request_timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] goodness_function = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] graceful_shutdown_timeout = 5 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] group_api_class = cinder.group.api.API {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] host = devstack {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_compress_on_upload = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_conversion_address_space_limit = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_conversion_cpu_limit = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_conversion_disable = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_introspection_address_space_limit = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_introspection_cpu_limit = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_upload_use_cinder_backend = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_upload_use_internal_tenant = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_volume_cache_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_volume_cache_max_count = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] image_volume_cache_max_size_gb = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] init_host_max_objects_retrieval = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] instance_format = [instance: %(uuid)s] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] iscsi_target_flags = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] iscsi_write_cache = on {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] iser_helper = tgtadm {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] iser_ip_address = 192.168.122.92 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] iser_port = 3260 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_color = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_config_append = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_dir = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_options = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_rotate_interval = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_rotate_interval_type = days {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] log_rotation_type = none {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] max_age = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] max_logfile_count = 30 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] max_logfile_size_mb = 200 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] max_over_subscription_ratio = 20.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] message_reap_interval = 86400 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] message_ttl = 2592000 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] migration_create_volume_timeout_secs = 300 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] monkey_patch = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] monkey_patch_modules = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] my_ip = 192.168.122.92 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] no_snapshot_gb_quota = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] num_iser_scan_tries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] num_shell_tries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] num_volume_device_scan_tries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] nvmeof_conn_info_version = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] nvmet_ns_id = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] nvmet_port_id = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_max_limit = 1000 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_volume_ext_list = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_volume_listen_port = 8776 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_volume_use_ssl = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] osapi_volume_workers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] per_volume_size_limit = -1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] periodic_fuzzy_delay = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] periodic_interval = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] public_endpoint = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] publish_errors = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_backup_gigabytes = 1000 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_backups = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_gigabytes = 1000 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_groups = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_snapshots = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] quota_volumes = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] rate_limit_burst = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] rate_limit_except_level = CRITICAL {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] rate_limit_interval = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] reinit_driver_count = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] replication_device = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] report_discard_supported = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] report_interval = 120 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] reservation_clean_interval = 86400 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] reservation_expire = 86400 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] reserved_image_namespaces = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] reserved_percentage = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] rpc_response_timeout = 120 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] run_external_periodic_tasks = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] scst_target_driver = iscsi {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] scst_target_iqn_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_down_time = 720 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] shell_completion = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] snapshot_name_template = snapshot-%s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] split_loggers = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] state_path = /opt/stack/data/cinder {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] storage_availability_zone = nova {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] storage_protocol = iSCSI {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] syslog_log_facility = LOG_USER {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] target_helper = lioadm {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] target_ip_address = 192.168.122.92 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] target_port = 3260 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] target_protocol = iscsi {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] target_secondary_ip_addresses = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] trace_flags = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] transport_url = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] until_refresh = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_chap_auth = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_default_quota_class = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:01 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_journal = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_json = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_multipath_for_image_xfer = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_stderr = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] use_syslog = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] verify_glance_signatures = enabled {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_api_class = cinder.volume.api.API {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_backend_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_clear = zero {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_clear_ionice = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_clear_size = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_copy_bps_limit = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_dd_blocksize = 1M {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_name_template = volume-%s {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_service_inithost_offload = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volume_usage_audit_period = month {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] zoning_mode = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_concurrency.disable_process_locking = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.auth_section = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.auth_type = password {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.auth_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.cache = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.include_service_catalog = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.interface = public {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcache_username = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.region_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.service_type = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.92/identity {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.backend = dogpile.cache.null {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.backend_argument = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.backend_expiration_time = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.config_prefix = cache.oslo {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.debug_cache_backend = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.enable_retry_client = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.enable_socket_keepalive = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.expiration_time = 600 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.hashclient_retry_attempts = 2 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_dead_retry = 300 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_pool_maxsize = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_sasl_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.proxies = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.redis_db = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.redis_server = localhost:6379 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.retry_attempts = 2 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.retry_delay = 0.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.socket_keepalive_count = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.socket_keepalive_idle = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.socket_keepalive_interval = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.socket_timeout = 1.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.tls_allowed_ciphers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.tls_cafile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.tls_certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.tls_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.tls_keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cache.username = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] coordination.backend_url = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.asyncio_connection = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.asyncio_slave_connection = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.backend = sqlalchemy {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.connection = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.connection_debug = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.connection_parameters = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.connection_recycle_time = 3600 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.connection_trace = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.db_inc_retry_interval = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.db_max_retries = 20 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.db_max_retry_interval = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.db_retry_interval = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.max_overflow = 50 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.max_pool_size = 5 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.max_retries = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86712]: INFO cinder.volume.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.remotefs [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86712) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.mysql_wsrep_sync_wait = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.pool_timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.retry_interval = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.slave_connection = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.sqlite_synchronous = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.synchronous_reader = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] database.use_db_reconnect = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_tracing.insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.connection_string = messaging:// {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.es_doc_type = notification {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.es_scroll_size = 10000 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.es_scroll_time = 2m {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.filter_error_trace = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.hmac_keys = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.sentinel_service_name = mymaster {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.socket_timeout = 0.1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.trace_requests = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler.trace_sqlalchemy = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler_jaeger.process_tags = {} {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler_jaeger.service_name_prefix = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] profiler_otlp.service_name_prefix = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.enforce_new_defaults = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.policy_default_rule = default {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.policy_file = policy.yaml {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.group = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.helper_command = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] privsep_osbrick.user = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.group = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.helper_command = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] cinder_sys_admin.user = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.auth_section = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.auth_type = password {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.cafile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.collect_timing = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.send_service_user_token = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.split_loggers = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.tls_ciphers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] service_user.tls_min_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.auth_section = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.auth_type = password {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.collect_timing = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.region_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.split_loggers = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.tls_ciphers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] glance.tls_min_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.backend_availability_zone = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.chap_password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.chap_username = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.disk_geometry = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.driver_client_cert = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.driver_client_cert_key = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.driver_data_namespace = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.driver_use_ssl = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.extra_capabilities = {} {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.filter_function = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.goodness_function = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.iscsi_target_flags = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.iscsi_write_cache = on {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.iser_helper = tgtadm {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.iser_ip_address = 192.168.122.92 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.iser_port = 3260 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_host = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_login = admin {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_mount_options = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_private_key = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_share_path = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.num_shell_tries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.quobyte_volume_url = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.replication_device = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.report_discard_supported = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.reserved_percentage = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.target_helper = tgtadm {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.target_ip_address = 192.168.122.92 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.target_port = 3260 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.target_protocol = iscsi {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.trace_flags = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.unique_fqdn_network = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.use_chap_auth = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_backend_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_clear = zero {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_clear_ionice = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_clear_size = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_reports.file_event_handler = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_reports.log_dir = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.backend_availability_zone = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.backend_host = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.chap_password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.chap_username = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.chiscsi_conf = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.disk_geometry = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.driver_client_cert = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.driver_data_namespace = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.driver_use_ssl = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.extra_capabilities = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.filter_function = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.goodness_function = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.iser_helper = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.iser_ip_address = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.iser_port = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.iser_target_prefix = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_host = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_login = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_mount_options = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_password = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_private_key = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_share_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_ssh_port = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.num_shell_tries = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.nvmet_port_id = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.replication_device = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.report_discard_supported = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.reserved_percentage = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.scst_target_driver = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.storage_protocol = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.target_helper = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.target_ip_address = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.target_port = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.target_prefix = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.target_protocol = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.trace_flags = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.use_chap_auth = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_clear = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_clear_size = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] QuobyteHD.volumes_dir = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_notifications.driver = [] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_notifications.retry = -1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] key_manager.fixed_key = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.barbican_api_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.barbican_endpoint = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.barbican_endpoint_type = public {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.barbican_region_name = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.cafile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86712) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:14:02 devstack cinder-volume[86712]: WARNING cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:14:02 devstack cinder-volume[86712]: WARNING cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Running cmd (subprocess): mount.quobyte {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.collect_timing = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.number_of_retries = 60 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.retry_delay = 1 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.send_service_user_token = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.split_loggers = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.tls_ciphers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.tls_min_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.verify_ssl = True {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican.verify_ssl_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.auth_section = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.auth_type = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.cafile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.certfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.collect_timing = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.insecure = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.keyfile = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.split_loggers = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.timeout = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.tls_ciphers = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] barbican_service_user.tls_min_version = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.approle_role_id = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.approle_secret_id = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.auth_method = approle {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.auth_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.kv_mountpoint = secret {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.kv_path = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.kv_version = 2 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.namespace = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.root_token_id = **** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.ssl_ca_crt_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.timeout = 60.0 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.token_file = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.token_role = None {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.use_ssl = False {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:02 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] ******************************************************************************** {{(pid=86493) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:14:02 devstack quobyte-client[86717]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 21:14:02 devstack quobyte-client[86717]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] CMD "mount.quobyte" returned: 1 in 0.104s {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=86712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:02 devstack cinder-volume[86712]: INFO cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f ... Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c -c /etc/quobyte/client-cinder.cfg {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:02 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c -c /etc/quobyte/client-cinder.cfg Nov 06 21:14:02 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:02 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.383s {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:02 devstack cinder-volume[86712]: INFO cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f succeeded Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=86712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:02 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:02 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:02 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.246s {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:02 devstack cinder-volume[86712]: INFO cinder.volume.driver [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG cinder.volume.driver [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86712) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG oslo_db.sqlalchemy.engines [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86712) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:02 devstack cinder-volume[86712]: DEBUG dbcounter [-] [86712] Writer thread running {{(pid=86712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.db.api [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Building query based on filter {{(pid=86712) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.image.image_utils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86712) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:14:03 devstack cinder-volume[86712]: INFO cinder.keymgr.migration [None req-c1c81ca9-f9ed-46c5-9f79-7f15212ea693 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=86712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=86712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:03 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:03 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:03 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.225s {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Notifying Schedulers of capabilities ... {{(pid=86712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:03 devstack cinder-volume[86712]: INFO cinder.volume.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Driver initialization completed successfully. Nov 06 21:14:03 devstack cinder-volume[86712]: INFO cinder.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Initiating service 3 cleanup Nov 06 21:14:03 devstack cinder-volume[86712]: INFO cinder.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Service 3 cleanup completed. Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.service [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Creating RPC server for service cinder-volume {{(pid=86712) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.service [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86712) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:14:03 devstack cinder-volume[86712]: INFO cinder.volume.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=86712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=86712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:03 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:03 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:03 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:03 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.275s {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:03 devstack cinder-volume[86712]: INFO cinder.volume.manager [None req-618821e5-db3c-404a-9b88-aabc19db9d81 None None] Driver post RPC initialization completed successfully. Nov 06 21:14:07 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:07 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:07 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=86712) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:07 devstack cinder-volume[86712]: DEBUG cinder.volume.drivers.quobyte [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=86712) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:07 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86712) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:07 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:07 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:07 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:08 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:08 devstack cinder-volume[86712]: DEBUG oslo_concurrency.processutils [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.215s {{(pid=86712) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:08 devstack cinder-volume[86712]: DEBUG cinder.manager [None req-9804382c-7744-4c0b-8e21-fe0806b3c760 None None] Notifying Schedulers of capabilities ... {{(pid=86712) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:11 devstack cinder-volume[86493]: INFO oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Caught SIGTERM, stopping children Nov 06 21:14:11 devstack cinder-volume[86493]: DEBUG oslo_concurrency.lockutils [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Acquiring lock "singleton_lock" {{(pid=86493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:11 devstack cinder-volume[86493]: DEBUG oslo_concurrency.lockutils [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Acquired lock "singleton_lock" {{(pid=86493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:11 devstack cinder-volume[86493]: DEBUG oslo_concurrency.lockutils [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Releasing lock "singleton_lock" {{(pid=86493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:11 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Stop services. {{(pid=86493) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:14:11 devstack cinder-volume[86493]: DEBUG oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Killing children. {{(pid=86493) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:14:11 devstack cinder-volume[86493]: INFO oslo_service.backend._eventlet.service [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Waiting on 1 children to exit Nov 06 21:14:13 devstack cinder-volume[86712]: DEBUG dbcounter [-] [86712] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:13 devstack cinder-volume[86712]: DEBUG dbcounter [-] [86712] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:16 devstack cinder-volume[86712]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 06 21:14:16 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Acquiring lock "singleton_lock" {{(pid=86712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:16 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Acquired lock "singleton_lock" {{(pid=86712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:16 devstack cinder-volume[86712]: DEBUG oslo_concurrency.lockutils [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Releasing lock "singleton_lock" {{(pid=86712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:16 devstack cinder-volume[86712]: WARNING amqp [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:14:16 devstack cinder-volume[86712]: WARNING amqp [None req-282f728a-1433-4429-8360-3aee96178c47 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:14:17 devstack cinder-volume[87056]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:14:17 devstack cinder-volume[87056]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:14:17 devstack cinder-volume[87056]: we strongly recommend against using it for new projects. Nov 06 21:14:17 devstack cinder-volume[87056]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:14:17 devstack cinder-volume[87056]: framework. For more detail see Nov 06 21:14:17 devstack cinder-volume[87056]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:14:17 devstack cinder-volume[87056]: import eventlet # noqa Nov 06 21:14:19 devstack cinder-volume[87056]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87056) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:14:19 devstack cinder-volume[87056]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87056) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:14:19 devstack cinder-volume[87056]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87056) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:14:20 devstack cinder-volume[87056]: INFO dbcounter [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Registered counter for database cinder Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_db.sqlalchemy.engines [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87056) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG dbcounter [-] [87056] Writer thread running {{(pid=87056) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:20 devstack cinder-volume[87056]: INFO cinder.rpc [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:14:20 devstack cinder-volume[87056]: INFO cinder.rpc [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_db.sqlalchemy.engines [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87056) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:20 devstack cinder-volume[87056]: INFO cinder.volume.manager [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Determined volume DB was empty at startup. Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG cinder.volume.manager [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87056) __init__ /opt/stack/cinder/cinder/volume/manager.py:293}} Nov 06 21:14:20 devstack cinder-volume[87056]: WARNING stevedore.named [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:20 devstack cinder-volume[87056]: WARNING castellan.key_manager [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:20 devstack cinder-volume[87056]: WARNING cinder.keymgr.conf_key_mgr [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:20 devstack cinder-volume[87056]: INFO cinder.volume.manager [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_db.sqlalchemy.engines [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87056) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:20 devstack cinder-volume[87056]: INFO oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Starting 1 workers Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Started child 87350 {{(pid=87056) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Full set of CONF: {{(pid=87056) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] ******************************************************************************** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] Configuration options gathered from: {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] ================================================================================ {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] allow_availability_zone_fallback = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] allow_compression_on_image_upload = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] allowed_direct_url_schemes = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87350]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] api_rate_limit = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] auth_strategy = keystone {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_availability_zone = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_host = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_stats_polling_interval = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backup_api_class = cinder.backup.api.API {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backup_name_template = backup-%s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backup_use_same_host = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backup_use_temp_snapshot = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] chap_password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] chap_username = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_internal_tenant_project_id = c4e6d1fa4bf542adba95016212eaa465 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_internal_tenant_user_id = 18b2558bf21e4bfe94cac1e84cb594c8 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cluster = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] compression_format = gzip {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] compute_api_class = cinder.compute.nova.API {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] config_dir = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] config_source = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] control_exchange = openstack {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] debug = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] default_availability_zone = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] default_group_type = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] default_volume_type = QuobyteHD {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] disk_geometry = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] driver_client_cert = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] driver_client_cert_key = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] driver_data_namespace = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] driver_ssl_cert_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] driver_ssl_cert_verify = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] driver_use_ssl = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] enable_new_services = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] enable_unsupported_driver = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] enabled_backends = ['QuobyteHD'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] enforce_multipath_for_image_xfer = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] filter_function = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_api_insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_api_servers = ['http://192.168.122.92/image'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_api_ssl_compression = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_ca_certificates_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_catalog_info = image:glance:publicURL {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_num_retries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance_request_timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] goodness_function = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] graceful_shutdown_timeout = 5 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] group_api_class = cinder.group.api.API {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] host = devstack {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_compress_on_upload = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_conversion_address_space_limit = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_conversion_cpu_limit = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_conversion_disable = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_introspection_address_space_limit = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_introspection_cpu_limit = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_upload_use_cinder_backend = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_upload_use_internal_tenant = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_volume_cache_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_volume_cache_max_count = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] image_volume_cache_max_size_gb = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] init_host_max_objects_retrieval = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] instance_format = [instance: %(uuid)s] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] iscsi_target_flags = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] iscsi_write_cache = on {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] iser_helper = tgtadm {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] iser_ip_address = 192.168.122.92 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] iser_port = 3260 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_color = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_config_append = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_dir = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_options = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_rotate_interval = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_rotate_interval_type = days {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] log_rotation_type = none {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] max_age = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] max_logfile_count = 30 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] max_logfile_size_mb = 200 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] max_over_subscription_ratio = 20.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] message_reap_interval = 86400 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] message_ttl = 2592000 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] migration_create_volume_timeout_secs = 300 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] monkey_patch = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] monkey_patch_modules = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] my_ip = 192.168.122.92 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] no_snapshot_gb_quota = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] num_iser_scan_tries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] num_shell_tries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] num_volume_device_scan_tries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] nvmeof_conn_info_version = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] nvmet_ns_id = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] nvmet_port_id = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_max_limit = 1000 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_volume_ext_list = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_volume_listen_port = 8776 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_volume_use_ssl = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] osapi_volume_workers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] per_volume_size_limit = -1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] periodic_fuzzy_delay = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] periodic_interval = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] public_endpoint = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] publish_errors = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_backup_gigabytes = 1000 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_backups = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_gigabytes = 1000 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_groups = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_snapshots = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] quota_volumes = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] rate_limit_burst = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] rate_limit_except_level = CRITICAL {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] rate_limit_interval = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] reinit_driver_count = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] replication_device = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] report_discard_supported = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] report_interval = 120 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] reservation_clean_interval = 86400 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] reservation_expire = 86400 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] reserved_image_namespaces = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] reserved_percentage = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87350) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] rpc_response_timeout = 120 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] run_external_periodic_tasks = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] scst_target_driver = iscsi {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] scst_target_iqn_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_down_time = 720 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] shell_completion = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] snapshot_name_template = snapshot-%s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] split_loggers = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] state_path = /opt/stack/data/cinder {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] storage_availability_zone = nova {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] storage_protocol = iSCSI {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] syslog_log_facility = LOG_USER {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] target_helper = lioadm {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] target_ip_address = 192.168.122.92 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] target_port = 3260 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] target_protocol = iscsi {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] target_secondary_ip_addresses = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] trace_flags = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] transport_url = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] until_refresh = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_chap_auth = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_default_quota_class = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_journal = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_json = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_multipath_for_image_xfer = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_stderr = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] use_syslog = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] verify_glance_signatures = enabled {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_api_class = cinder.volume.api.API {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_backend_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_clear = zero {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_clear_ionice = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_clear_size = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_copy_bps_limit = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_dd_blocksize = 1M {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_name_template = volume-%s {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_service_inithost_offload = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volume_usage_audit_period = month {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] zoning_mode = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_concurrency.disable_process_locking = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.auth_section = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.auth_type = password {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.auth_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.cache = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.include_service_catalog = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.interface = public {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcache_username = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.region_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.service_type = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.92/identity {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.backend = dogpile.cache.null {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.backend_argument = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.backend_expiration_time = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.config_prefix = cache.oslo {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.debug_cache_backend = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.enable_retry_client = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.enable_socket_keepalive = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.expiration_time = 600 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.hashclient_retry_attempts = 2 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_dead_retry = 300 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_pool_maxsize = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_sasl_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.proxies = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.redis_db = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.redis_server = localhost:6379 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.retry_attempts = 2 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.retry_delay = 0.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.socket_keepalive_count = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.socket_keepalive_idle = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.socket_keepalive_interval = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.socket_timeout = 1.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.tls_allowed_ciphers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.tls_cafile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.tls_certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.tls_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.tls_keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cache.username = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] coordination.backend_url = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87350) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.asyncio_connection = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.asyncio_slave_connection = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.backend = sqlalchemy {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.connection = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.connection_debug = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.connection_parameters = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Running cmd (subprocess): mount.quobyte {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.connection_recycle_time = 3600 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.connection_trace = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.db_inc_retry_interval = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.db_max_retries = 20 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.db_max_retry_interval = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.db_retry_interval = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.max_overflow = 50 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.max_pool_size = 5 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.max_retries = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.mysql_wsrep_sync_wait = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.pool_timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.retry_interval = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.slave_connection = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.sqlite_synchronous = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.synchronous_reader = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] database.use_db_reconnect = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:20 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_tracing.insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.connection_string = messaging:// {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.es_doc_type = notification {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.es_scroll_size = 10000 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.es_scroll_time = 2m {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.filter_error_trace = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.hmac_keys = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.sentinel_service_name = mymaster {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.socket_timeout = 0.1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.trace_requests = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler.trace_sqlalchemy = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler_jaeger.process_tags = {} {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler_jaeger.service_name_prefix = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] profiler_otlp.service_name_prefix = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.enforce_new_defaults = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.policy_default_rule = default {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.policy_file = policy.yaml {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.group = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.helper_command = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] privsep_osbrick.user = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.group = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.helper_command = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] cinder_sys_admin.user = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.auth_section = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.auth_type = password {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.cafile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.collect_timing = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.send_service_user_token = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.split_loggers = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.tls_ciphers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] service_user.tls_min_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.auth_section = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.auth_type = password {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.collect_timing = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.region_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.split_loggers = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.tls_ciphers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] glance.tls_min_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.backend_availability_zone = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.chap_password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.chap_username = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.disk_geometry = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.driver_client_cert = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.driver_client_cert_key = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.driver_data_namespace = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.driver_use_ssl = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.extra_capabilities = {} {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.filter_function = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.goodness_function = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.iscsi_target_flags = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.iscsi_write_cache = on {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.iser_helper = tgtadm {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.iser_ip_address = 192.168.122.92 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.iser_port = 3260 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_host = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_login = admin {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_mount_options = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_private_key = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_share_path = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.num_shell_tries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.quobyte_volume_url = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.replication_device = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.report_discard_supported = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.reserved_percentage = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.target_helper = tgtadm {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.target_ip_address = 192.168.122.92 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.target_port = 3260 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.target_protocol = iscsi {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.trace_flags = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.unique_fqdn_network = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.use_chap_auth = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_backend_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_clear = zero {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_clear_ionice = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_clear_size = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_reports.file_event_handler = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_reports.log_dir = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.backend_availability_zone = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.backend_host = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.chap_password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.chap_username = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.chiscsi_conf = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.disk_geometry = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.driver_client_cert = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.driver_data_namespace = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.driver_use_ssl = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.extra_capabilities = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.filter_function = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.goodness_function = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.iser_helper = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.iser_ip_address = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.iser_port = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.iser_target_prefix = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_host = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_login = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_mount_options = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_password = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_private_key = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_share_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_ssh_port = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.num_shell_tries = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.nvmet_port_id = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.replication_device = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.report_discard_supported = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.reserved_percentage = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.scst_target_driver = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.storage_protocol = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.target_helper = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.target_ip_address = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.target_port = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.target_prefix = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.target_protocol = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.trace_flags = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.use_chap_auth = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_clear = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_clear_size = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] QuobyteHD.volumes_dir = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_notifications.driver = [] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_notifications.retry = -1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] key_manager.fixed_key = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.barbican_api_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.barbican_endpoint = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.barbican_endpoint_type = public {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.barbican_region_name = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.cafile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.collect_timing = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.number_of_retries = 60 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.retry_delay = 1 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.send_service_user_token = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.split_loggers = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.tls_ciphers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.tls_min_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.verify_ssl = True {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican.verify_ssl_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.auth_section = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.auth_type = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.cafile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.certfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.collect_timing = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.insecure = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.keyfile = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.split_loggers = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.timeout = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.tls_ciphers = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] barbican_service_user.tls_min_version = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.approle_role_id = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.approle_secret_id = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.auth_method = approle {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.auth_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.kv_mountpoint = secret {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.kv_path = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.kv_version = 2 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.namespace = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.root_token_id = **** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.ssl_ca_crt_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.timeout = 60.0 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.token_file = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.token_role = None {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.use_ssl = False {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:14:21 devstack cinder-volume[87056]: DEBUG oslo_service.backend._eventlet.service [None req-d81e49dc-8d0a-4bf0-9c65-fa2b9f404002 None None] ******************************************************************************** {{(pid=87056) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:14:21 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.246s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87350]: INFO cinder.volume.driver [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.driver [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87350) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_db.sqlalchemy.engines [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writer thread running {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.db.api [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Building query based on filter {{(pid=87350) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87350) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack cinder-volume[87350]: INFO cinder.keymgr.migration [None req-1124ba3d-bb0a-4407-ba68-4a02fec94348 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:14:21 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:21 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:21 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.242s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:14:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Driver initialization completed successfully. Nov 06 21:14:21 devstack cinder-volume[87350]: INFO cinder.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Initiating service 3 cleanup Nov 06 21:14:21 devstack cinder-volume[87350]: INFO cinder.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Service 3 cleanup completed. Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.service [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Creating RPC server for service cinder-volume {{(pid=87350) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.service [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87350) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:14:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:14:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:14:21 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:14:21 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:14:22 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Nov 06 21:14:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.240s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:14:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a60429b7-033b-4fa7-9bdc-cf820225e59c None None] Driver post RPC initialization completed successfully. Nov 06 21:14:30 devstack cinder-volume[87056]: DEBUG dbcounter [-] [87056] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87056) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:31 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=3 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:14:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:14:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 6 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:14:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:32 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:15:32 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:33 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.938s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:15:33 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:15:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 6 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:15:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Flow 'volume_create_manager' (4354581f-65b8-4f68-9d63-345b1021ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa88ddf2-2d8c-476c-985c-0426bce8e838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa88ddf2-2d8c-476c-985c-0426bce8e838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-876856935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08cdf5c6-c354-4478-a861-1db1694d60b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476a2c1d602b4ab98abe9309dfbf671e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:40Z,use_quota=True,user_id='008c685ea5e84c0f8b54586c995d462c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f758f3-5d49-4e1a-8e98-a2dd6856d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f758f3-5d49-4e1a-8e98-a2dd6856d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f63d84c-0aec-4731-b048-929279b5331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f63d84c-0aec-4731-b048-929279b5331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08cdf5c6-c354-4478-a861-1db1694d60b6', 'volume_name': 'volume-08cdf5c6-c354-4478-a861-1db1694d60b6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88a5b47-a9fa-4c12-9b04-3e4cc4320cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88a5b47-a9fa-4c12-9b04-3e4cc4320cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a323ff5e-bd53-4fd7-a7fd-bebdcb950610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:40 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Volume 08cdf5c6-c354-4478-a861-1db1694d60b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08cdf5c6-c354-4478-a861-1db1694d60b6', 'volume_size': 1} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-876856935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08cdf5c6-c354-4478-a861-1db1694d60b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476a2c1d602b4ab98abe9309dfbf671e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:40Z,use_quota=True,user_id='008c685ea5e84c0f8b54586c995d462c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Creating volume 08cdf5c6-c354-4478-a861-1db1694d60b6 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:40 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:15:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:40 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 1073741824 Nov 06 21:15:40 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:41 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 1073741824" returned: 0 in 1.173s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:41 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 Nov 06 21:15:41 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:42 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6" returned: 0 in 0.651s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a323ff5e-bd53-4fd7-a7fd-bebdcb950610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08cdf5c6-c354-4478-a861-1db1694d60b6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb91c5d9-bf37-474d-bf5a-667551b06e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Volume volume-08cdf5c6-c354-4478-a861-1db1694d60b6 (08cdf5c6-c354-4478-a861-1db1694d60b6): created successfully Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb91c5d9-bf37-474d-bf5a-667551b06e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Flow 'volume_create_manager' (4354581f-65b8-4f68-9d63-345b1021ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7986c7b4-0df7-4cad-aeac-2b9dc74e5551 tempest-DeleteServersTestJSON-1599052221 None] Created volume successfully. Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Flow 'volume_create_manager' (5f3a1076-4fdd-40bf-9fb8-b2636339f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a811833b-4808-4526-8941-28a1c5dcb06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a811833b-4808-4526-8941-28a1c5dcb06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1213610644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dcb429-98bc-4715-8568-b4797284b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55ed3dbcc484cb084177c746a2d46b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:50Z,use_quota=True,user_id='0910e79bf5fe4b0d9b75a86f039ae463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9781ae-4da4-4bf2-a48b-dd6404ff9fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9781ae-4da4-4bf2-a48b-dd6404ff9fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25156c29-ae1c-454d-8c54-62ca1232b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25156c29-ae1c-454d-8c54-62ca1232b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85dcb429-98bc-4715-8568-b4797284b897', 'volume_name': 'volume-85dcb429-98bc-4715-8568-b4797284b897', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d263bf-f37e-4e51-8b99-5803010cce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d263bf-f37e-4e51-8b99-5803010cce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46accf00-e5f1-4a00-bfa3-0470e33d50bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Volume 85dcb429-98bc-4715-8568-b4797284b897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85dcb429-98bc-4715-8568-b4797284b897', 'volume_size': 1} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1213610644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dcb429-98bc-4715-8568-b4797284b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55ed3dbcc484cb084177c746a2d46b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:50Z,use_quota=True,user_id='0910e79bf5fe4b0d9b75a86f039ae463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Creating volume 85dcb429-98bc-4715-8568-b4797284b897 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:50 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:50 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 1073741824 Nov 06 21:15:50 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:50 devstack cinder-volume[87350]: WARNING py.warnings [req-31ab5fe7-35ed-4b6c-af92-1eb4ca5eb8e0 req-1e740c6b-956b-4bc2-aca8-dc7b50212697 tempest-DeleteServersTestJSON-1599052221 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 06 21:15:50 devstack cinder-volume[87350]: .first() Nov 06 21:15:50 devstack cinder-volume[87350]: Nov 06 21:15:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-31ab5fe7-35ed-4b6c-af92-1eb4ca5eb8e0 req-1e740c6b-956b-4bc2-aca8-dc7b50212697 tempest-DeleteServersTestJSON-1599052221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 1073741824" returned: 0 in 1.123s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:51 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:51 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 Nov 06 21:15:51 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:52 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897" returned: 0 in 0.572s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-31ab5fe7-35ed-4b6c-af92-1eb4ca5eb8e0 req-1e740c6b-956b-4bc2-aca8-dc7b50212697 tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.164s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46accf00-e5f1-4a00-bfa3-0470e33d50bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dcb429-98bc-4715-8568-b4797284b897', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4e013a-a554-4bfd-bf84-238bea310e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Volume volume-85dcb429-98bc-4715-8568-b4797284b897 (85dcb429-98bc-4715-8568-b4797284b897): created successfully Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4e013a-a554-4bfd-bf84-238bea310e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Flow 'volume_create_manager' (5f3a1076-4fdd-40bf-9fb8-b2636339f764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-31ab5fe7-35ed-4b6c-af92-1eb4ca5eb8e0 req-1e740c6b-956b-4bc2-aca8-dc7b50212697 tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.221s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4f2d6800-7276-47a1-be3c-b34b6538c96c tempest-VolumesAdminNegativeTest-1270678971 None] Created volume successfully. Nov 06 21:15:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-31ab5fe7-35ed-4b6c-af92-1eb4ca5eb8e0 req-1e740c6b-956b-4bc2-aca8-dc7b50212697 tempest-DeleteServersTestJSON-1599052221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-08cdf5c6-c354-4478-a861-1db1694d60b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5dc17575-c13a-4992-9287-c9a9c31d1643', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:15:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-31ab5fe7-35ed-4b6c-af92-1eb4ca5eb8e0 req-1e740c6b-956b-4bc2-aca8-dc7b50212697 tempest-DeleteServersTestJSON-1599052221 None] attachment_update completed successfully. Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Acquiring lock "cinder-85dcb429-98bc-4715-8568-b4797284b897-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Flow 'volume_create_manager' (c37e1594-6e17-4f1d-9eb1-f0545d2b8452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312f102f-f4c4-4e83-96fa-4a4f1ce2827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Lock "cinder-85dcb429-98bc-4715-8568-b4797284b897-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312f102f-f4c4-4e83-96fa-4a4f1ce2827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1845268488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e23449-eb4f-4508-ace3-20688df3d43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fb41c623d64990a5e18bba8d5a3e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:54Z,use_quota=True,user_id='31db16fcc56f4f8f89cc07fb258af1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156aa745-4ef2-464d-bc47-4b4fbef96523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156aa745-4ef2-464d-bc47-4b4fbef96523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44802127-ec5c-4250-8478-f98638255be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44802127-ec5c-4250-8478-f98638255be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e23449-eb4f-4508-ace3-20688df3d43b', 'volume_name': 'volume-38e23449-eb4f-4508-ace3-20688df3d43b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bec7ae7-26a9-41c1-a541-1fbe24dd5995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bec7ae7-26a9-41c1-a541-1fbe24dd5995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8368b08-bf55-4ccb-bc47-8f9fa72d73e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:54 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Volume 38e23449-eb4f-4508-ace3-20688df3d43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e23449-eb4f-4508-ace3-20688df3d43b', 'volume_size': 1} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1845268488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e23449-eb4f-4508-ace3-20688df3d43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fb41c623d64990a5e18bba8d5a3e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:15:54Z,use_quota=True,user_id='31db16fcc56f4f8f89cc07fb258af1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Creating volume 38e23449-eb4f-4508-ace3-20688df3d43b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:15:54 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:54 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b 1073741824 Nov 06 21:15:54 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Acquiring lock "cinder-quobyte-85dcb429-98bc-4715-8568-b4797284b897" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:15:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Lock "cinder-quobyte-85dcb429-98bc-4715-8568-b4797284b897" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:15:54 devstack cinder-volume[87350]: INFO oslo.privsep.daemon [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu7c_ndvu/privsep.sock'] Nov 06 21:15:54 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu7c_ndvu/privsep.sock Nov 06 21:15:54 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:55 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b 1073741824" returned: 0 in 1.298s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:55 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b Nov 06 21:15:55 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:56 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8368b08-bf55-4ccb-bc47-8f9fa72d73e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e23449-eb4f-4508-ace3-20688df3d43b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a4b706-210b-4eea-88d3-88c826dd4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:15:56 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Volume volume-38e23449-eb4f-4508-ace3-20688df3d43b (38e23449-eb4f-4508-ace3-20688df3d43b): created successfully Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a4b706-210b-4eea-88d3-88c826dd4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:15:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Flow 'volume_create_manager' (c37e1594-6e17-4f1d-9eb1-f0545d2b8452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:15:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2cb049b7-a33e-4d81-830a-94f56c18b873 tempest-ServerRescueNegativeTestJSON-1389287341 None] Created volume successfully. Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:15:57 devstack cinder-volume[87350]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 21:15:58 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:58 devstack cinder-volume[87350]: INFO oslo.privsep.daemon [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Spawned new privsep daemon via rootwrap Nov 06 21:15:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Accepted privsep connection to /tmp/tmpu7c_ndvu/privsep.sock {{(pid=87350) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 21:15:58 devstack cinder-volume[87350]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 21:15:58 devstack cinder-volume[87350]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 21:15:58 devstack cinder-volume[87350]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 21:15:58 devstack cinder-volume[87350]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89117 Nov 06 21:15:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6fde1-a995-45db-88d5-3858f23f0b4d]: (2,) {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:15:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[354020ee-f84c-4695-a8f1-cbd2395fae94]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:15:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:59 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 Nov 06 21:15:59 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:15:59 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Nov 06 21:15:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897" returned: 0 in 0.888s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:15:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:15:59 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897 Nov 06 21:15:59 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:00 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-85dcb429-98bc-4715-8568-b4797284b897" returned: 0 in 0.689s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Lock "cinder-quobyte-85dcb429-98bc-4715-8568-b4797284b897" released by "delete_volume" :: held 5.843s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:00 devstack cinder-volume[87350]: WARNING cinder.quota [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:16:00 devstack cinder-volume[87350]: WARNING cinder.quota [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Created reservations ['ba4ce150-1562-470e-9497-12a05ed94f88', '898758e2-956a-425c-b7ab-707d212a5bb7', 'dafc8a3d-d85c-416f-850a-2ee11c2cbad4', '2bae58b9-e6d6-4a84-b570-0b487449dc30'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:00 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:16:00 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:01 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.577s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:01 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:01 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Deleted volume successfully. Nov 06 21:16:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7caa3fa1-29c1-45f8-970d-296f5940b2db tempest-VolumesAdminNegativeTest-1270678971 None] Lock "cinder-85dcb429-98bc-4715-8568-b4797284b897-delete_volume" released by "delete_volume" :: held 7.086s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-67af428f-bfb5-47df-9472-0d061e4ab6de req-122fa599-96bd-4a48-a6d0-f655177a8917 tempest-DeleteServersTestJSON-1599052221 None] Terminate volume connection completed successfully. Nov 06 21:16:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-67af428f-bfb5-47df-9472-0d061e4ab6de req-122fa599-96bd-4a48-a6d0-f655177a8917 tempest-DeleteServersTestJSON-1599052221 None] Deleting attachment 5dc17575-c13a-4992-9287-c9a9c31d1643. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:16:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Acquiring lock "cinder-08cdf5c6-c354-4478-a861-1db1694d60b6-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Lock "cinder-08cdf5c6-c354-4478-a861-1db1694d60b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Acquiring lock "cinder-quobyte-08cdf5c6-c354-4478-a861-1db1694d60b6" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Lock "cinder-quobyte-08cdf5c6-c354-4478-a861-1db1694d60b6" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe8075-57b6-4d4d-a58c-e3fc5ad8c00c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:05 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 Nov 06 21:16:05 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:06 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6" returned: 0 in 0.716s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:06 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6 Nov 06 21:16:06 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:06 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08cdf5c6-c354-4478-a861-1db1694d60b6" returned: 0 in 0.413s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Lock "cinder-quobyte-08cdf5c6-c354-4478-a861-1db1694d60b6" released by "delete_volume" :: held 1.266s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Created reservations ['a944399c-ccd4-461a-b89e-0671b47c8ee9', '5285dceb-7e8a-4f48-97aa-e25f484a411c', '98e53850-6f0e-4f0d-918f-902764676e58', '9c99a494-2604-4776-b720-c8045e32701f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:07 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:16:07 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:07 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.351s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Deleted volume successfully. Nov 06 21:16:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0446be74-5a48-4126-86a8-9136fe65b9af tempest-DeleteServersTestJSON-1599052221 None] Lock "cinder-08cdf5c6-c354-4478-a861-1db1694d60b6-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Acquiring lock "cinder-38e23449-eb4f-4508-ace3-20688df3d43b-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "cinder-38e23449-eb4f-4508-ace3-20688df3d43b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Acquiring lock "cinder-quobyte-38e23449-eb4f-4508-ace3-20688df3d43b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:16:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "cinder-quobyte-38e23449-eb4f-4508-ace3-20688df3d43b" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:16:16 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e54088-d9a1-4921-a56e-bd314d5f524c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:16:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:17 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b Nov 06 21:16:17 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:17 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b" returned: 0 in 0.722s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:17 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b Nov 06 21:16:17 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:18 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-38e23449-eb4f-4508-ace3-20688df3d43b" returned: 0 in 0.757s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "cinder-quobyte-38e23449-eb4f-4508-ace3-20688df3d43b" released by "delete_volume" :: held 1.575s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Created reservations ['a2118120-3a82-4ca6-a466-e79f1b486cce', '23aa084c-69e0-4fc6-8ca6-a1188d5f3d48', 'e0ecfc91-6b9b-40c4-942b-c204b9a4ed11', 'ac5c8717-21ad-49c9-b2c8-2ab1e048f37b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:18 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:16:18 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:19 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.472s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:19 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Deleted volume successfully. Nov 06 21:16:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7327467-63cd-4819-ab32-f18caeb5d9a5 tempest-ServerRescueNegativeTestJSON-1389287341 None] Lock "cinder-38e23449-eb4f-4508-ace3-20688df3d43b-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=32,cinder:SELECT=28,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=30,cinder:UPDATE=38,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:16:32 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:16:32 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:32 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Flow 'volume_create_manager' (c2e9559e-ca2c-4939-b5e2-539f19a6e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6e3b15-796c-48ad-ab5f-5142393248ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6e3b15-796c-48ad-ab5f-5142393248ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-957306452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4874dd8b-01eb-43c9-94e2-1f7ff7a0787f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca78523b2d28441ea3cdb240a16913b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:53Z,use_quota=True,user_id='a6be0d89b17d4e33976989ce77ee4cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92f0c5a-5bb3-4f6a-beb0-46409637c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92f0c5a-5bb3-4f6a-beb0-46409637c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6d87f0-d692-44e4-ad8a-78ad85864dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6d87f0-d692-44e4-ad8a-78ad85864dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4874dd8b-01eb-43c9-94e2-1f7ff7a0787f', 'volume_name': 'volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18964cc7-887a-486c-a560-19d2650571b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18964cc7-887a-486c-a560-19d2650571b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0054c1-d45c-4439-a468-18a884dad645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:53 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Volume 4874dd8b-01eb-43c9-94e2-1f7ff7a0787f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f', 'volume_size': 1} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-957306452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4874dd8b-01eb-43c9-94e2-1f7ff7a0787f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca78523b2d28441ea3cdb240a16913b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:16:53Z,use_quota=True,user_id='a6be0d89b17d4e33976989ce77ee4cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Creating volume 4874dd8b-01eb-43c9-94e2-1f7ff7a0787f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:16:53 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:16:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:53 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f 1073741824 Nov 06 21:16:53 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:54 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f 1073741824" returned: 0 in 0.512s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:16:54 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f Nov 06 21:16:54 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:16:54 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f" returned: 0 in 0.283s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0054c1-d45c-4439-a468-18a884dad645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22305b5c-992f-4b71-9cf1-abb96fcdcad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:16:54 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Volume volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f (4874dd8b-01eb-43c9-94e2-1f7ff7a0787f): created successfully Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22305b5c-992f-4b71-9cf1-abb96fcdcad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:16:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Flow 'volume_create_manager' (c2e9559e-ca2c-4939-b5e2-539f19a6e90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:16:54 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ec8191dc-e863-4956-a5c6-fc088854bac1 tempest-TaggedAttachmentsTest-339523951 None] Created volume successfully. Nov 06 21:17:04 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:04 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:32 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:17:32 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:32 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 8 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:17:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Flow 'volume_create_manager' (cd0ed34b-e979-4541-bd93-4c3aa889df1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5892d98-3436-43d1-b9a1-3c4b5909610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5892d98-3436-43d1-b9a1-3c4b5909610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-829400532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aca2942-81a0-4581-90c3-9920117fa8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a1c305f514e07b7e274af2cca2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:35Z,use_quota=True,user_id='d707962e2b3848d98eaf1e252a93bd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f321c20-3900-4947-bd34-a02b1679cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f321c20-3900-4947-bd34-a02b1679cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7453f357-cc8d-437f-b53b-ee0589bb2e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7453f357-cc8d-437f-b53b-ee0589bb2e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aca2942-81a0-4581-90c3-9920117fa8b7', 'volume_name': 'volume-6aca2942-81a0-4581-90c3-9920117fa8b7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01d5e0a-e97a-46ec-9ce5-3498ed7c20cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01d5e0a-e97a-46ec-9ce5-3498ed7c20cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28ec3e3-47c1-4498-b8c9-cf0f445232f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Volume 6aca2942-81a0-4581-90c3-9920117fa8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aca2942-81a0-4581-90c3-9920117fa8b7', 'volume_size': 1} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-829400532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aca2942-81a0-4581-90c3-9920117fa8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a1c305f514e07b7e274af2cca2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:35Z,use_quota=True,user_id='d707962e2b3848d98eaf1e252a93bd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Creating volume 6aca2942-81a0-4581-90c3-9920117fa8b7 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:35 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:17:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:35 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 1073741824 Nov 06 21:17:35 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:36 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 1073741824" returned: 0 in 0.907s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:36 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 Nov 06 21:17:36 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:37 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7" returned: 0 in 0.647s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28ec3e3-47c1-4498-b8c9-cf0f445232f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aca2942-81a0-4581-90c3-9920117fa8b7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e394dca-459c-4104-b41b-1c8708413df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Volume volume-6aca2942-81a0-4581-90c3-9920117fa8b7 (6aca2942-81a0-4581-90c3-9920117fa8b7): created successfully Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e394dca-459c-4104-b41b-1c8708413df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Flow 'volume_create_manager' (cd0ed34b-e979-4541-bd93-4c3aa889df1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-860614d4-1f97-43f6-a357-31ccdee2e3d6 tempest-ServerActionsTestOtherA-404795317 None] Created volume successfully. Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Flow 'volume_create_manager' (8d1beb0f-c818-48ee-9bba-734a6997500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d6ea36-bf5f-4012-99e1-96952773eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d6ea36-bf5f-4012-99e1-96952773eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1841918057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c79ae7-f70f-4fcf-a169-423239657869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd8fd33bd14554959ac8a76928c367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:43Z,use_quota=True,user_id='476e03f84672496eb78ecc8d158f4feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9879811d-328c-4b32-b72c-562445d56c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9879811d-328c-4b32-b72c-562445d56c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b79be9-1dc6-438c-b874-59a9bd4a21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b79be9-1dc6-438c-b874-59a9bd4a21a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45c79ae7-f70f-4fcf-a169-423239657869', 'volume_name': 'volume-45c79ae7-f70f-4fcf-a169-423239657869', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c03b6f6-8824-457c-a2bd-b2c37e98f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c03b6f6-8824-457c-a2bd-b2c37e98f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7f4e99-5758-4762-9ecd-ae03411a76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Volume 45c79ae7-f70f-4fcf-a169-423239657869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45c79ae7-f70f-4fcf-a169-423239657869', 'volume_size': 1} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1841918057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45c79ae7-f70f-4fcf-a169-423239657869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd8fd33bd14554959ac8a76928c367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:43Z,use_quota=True,user_id='476e03f84672496eb78ecc8d158f4feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Creating volume 45c79ae7-f70f-4fcf-a169-423239657869 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:43 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:17:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:43 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 1073741824 Nov 06 21:17:43 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:44 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 1073741824" returned: 0 in 0.596s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:44 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 Nov 06 21:17:44 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:44 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869" returned: 0 in 0.284s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7f4e99-5758-4762-9ecd-ae03411a76d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c79ae7-f70f-4fcf-a169-423239657869', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299b503e-0086-4e98-b3bd-b80397e189cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:44 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Volume volume-45c79ae7-f70f-4fcf-a169-423239657869 (45c79ae7-f70f-4fcf-a169-423239657869): created successfully Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299b503e-0086-4e98-b3bd-b80397e189cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Flow 'volume_create_manager' (8d1beb0f-c818-48ee-9bba-734a6997500c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-422835f5-a759-42ea-a6b9-e95001379c84 tempest-ServersNegativeTestJSON-1966181628 None] Created volume successfully. Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Flow 'volume_create_manager' (90eb4ba5-5a28-4f67-b138-c9673ac9262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c977ed65-4727-442b-931b-1af11e8d9a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c977ed65-4727-442b-931b-1af11e8d9a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1006519478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c5db52-7b9e-4270-a1f7-03fb666710ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd8fd33bd14554959ac8a76928c367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:47Z,use_quota=True,user_id='476e03f84672496eb78ecc8d158f4feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae80e582-318e-4d6a-b9e4-9237f5b10c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae80e582-318e-4d6a-b9e4-9237f5b10c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08a3310-840a-459b-846b-b8c5348ebc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08a3310-840a-459b-846b-b8c5348ebc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c5db52-7b9e-4270-a1f7-03fb666710ab', 'volume_name': 'volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c445df7f-1826-4d63-bfdf-a5eed257f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c445df7f-1826-4d63-bfdf-a5eed257f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914889c6-9a10-42eb-8c17-461e036c275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Volume b3c5db52-7b9e-4270-a1f7-03fb666710ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab', 'volume_size': 1} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1006519478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c5db52-7b9e-4270-a1f7-03fb666710ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ffd8fd33bd14554959ac8a76928c367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:17:47Z,use_quota=True,user_id='476e03f84672496eb78ecc8d158f4feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Creating volume b3c5db52-7b9e-4270-a1f7-03fb666710ab {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:17:47 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:17:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:47 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab 1073741824 Nov 06 21:17:47 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:48 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab 1073741824" returned: 0 in 0.542s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:48 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab Nov 06 21:17:48 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:48 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab" returned: 0 in 0.335s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914889c6-9a10-42eb-8c17-461e036c275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba68bea8-036d-4fb8-8d39-9ee3f425d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:17:48 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Volume volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab (b3c5db52-7b9e-4270-a1f7-03fb666710ab): created successfully Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba68bea8-036d-4fb8-8d39-9ee3f425d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:17:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Flow 'volume_create_manager' (90eb4ba5-5a28-4f67-b138-c9673ac9262a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:17:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-dcc5b4f1-6383-41ca-8395-2651d0248c5f tempest-ServersNegativeTestJSON-1966181628 None] Created volume successfully. Nov 06 21:17:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "cinder-b3c5db52-7b9e-4270-a1f7-03fb666710ab-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-b3c5db52-7b9e-4270-a1f7-03fb666710ab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "cinder-quobyte-b3c5db52-7b9e-4270-a1f7-03fb666710ab" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-quobyte-b3c5db52-7b9e-4270-a1f7-03fb666710ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:49 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[510347c8-76ff-4b35-8f6f-a2ef8556f55f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:50 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab Nov 06 21:17:50 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:50 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab" returned: 0 in 0.502s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:50 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab Nov 06 21:17:50 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:50 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3c5db52-7b9e-4270-a1f7-03fb666710ab" returned: 0 in 0.261s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-quobyte-b3c5db52-7b9e-4270-a1f7-03fb666710ab" released by "delete_volume" :: held 0.814s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Created reservations ['2be7e0eb-2d1a-41ff-9d12-9a33edc9aa2c', 'cdda4a31-21fe-409f-a8e2-9af2ad972c07', 'dd41f182-5072-491b-88f1-038a0dc2fe1d', 'a113d855-1519-40b2-9543-e9d2eade7099'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:50 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:17:50 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "cinder-45c79ae7-f70f-4fcf-a169-423239657869-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-45c79ae7-f70f-4fcf-a169-423239657869-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "cinder-quobyte-45c79ae7-f70f-4fcf-a169-423239657869" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:17:51 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.462s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:51 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Deleted volume successfully. Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-quobyte-45c79ae7-f70f-4fcf-a169-423239657869" acquired by "delete_volume" :: waited 0.064s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f15bc8d8-7b28-4dda-8e6f-5b671daaaebb tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-b3c5db52-7b9e-4270-a1f7-03fb666710ab-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c576ec8a-4373-4c79-a23a-1c866f18d602]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:17:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:51 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 Nov 06 21:17:51 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:52 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869" returned: 0 in 0.610s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:52 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869 Nov 06 21:17:52 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:52 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-45c79ae7-f70f-4fcf-a169-423239657869" returned: 0 in 0.321s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-quobyte-45c79ae7-f70f-4fcf-a169-423239657869" released by "delete_volume" :: held 1.027s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Created reservations ['b2886963-3840-47fe-804b-5feb413db283', '9b79a877-79a2-4fc8-9dde-afd63026262a', '70fc8327-41d4-4fcc-8894-d91bee662d36', '67428b36-7bc4-449c-aaa2-cc1d7d10fd5c'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:17:52 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:17:52 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:17:52 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.321s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:17:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Deleted volume successfully. Nov 06 21:17:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-95402567-ad95-4664-a97f-14500045f7cd tempest-ServersNegativeTestJSON-1966181628 None] Lock "cinder-45c79ae7-f70f-4fcf-a169-423239657869-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=16,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Flow 'volume_create_manager' (d8ba94cc-b18e-486e-8342-d4dad52810fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd52f0b2-f6a4-42c1-b5ea-433ec6705ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd52f0b2-f6a4-42c1-b5ea-433ec6705ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1713690871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27339f78-54eb-4551-a711-172f1673ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7949fb254aa2439bb22751c54595e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:03Z,use_quota=True,user_id='a6ac4994339f48c780d26b5ff5e77363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa8cfdf-cd21-416f-b098-c81c022b188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa8cfdf-cd21-416f-b098-c81c022b188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f8f1fe-eb96-4688-a843-bc8a8d41126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f8f1fe-eb96-4688-a843-bc8a8d41126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27339f78-54eb-4551-a711-172f1673ee57', 'volume_name': 'volume-27339f78-54eb-4551-a711-172f1673ee57', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f2ed05-eb4a-4558-a04f-4cc40d4a2844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f2ed05-eb4a-4558-a04f-4cc40d4a2844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28db57b-79b5-47b1-bd35-aaae11f53555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Volume 27339f78-54eb-4551-a711-172f1673ee57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27339f78-54eb-4551-a711-172f1673ee57', 'volume_size': 1} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1713690871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27339f78-54eb-4551-a711-172f1673ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7949fb254aa2439bb22751c54595e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:18:03Z,use_quota=True,user_id='a6ac4994339f48c780d26b5ff5e77363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Creating volume 27339f78-54eb-4551-a711-172f1673ee57 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:18:02 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:18:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:02 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 1073741824 Nov 06 21:18:02 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:03 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 1073741824" returned: 0 in 0.506s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:03 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 Nov 06 21:18:03 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:03 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57" returned: 0 in 0.275s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28db57b-79b5-47b1-bd35-aaae11f53555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27339f78-54eb-4551-a711-172f1673ee57', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97002d28-bc9c-42be-b646-8e95d367fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:18:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Volume volume-27339f78-54eb-4551-a711-172f1673ee57 (27339f78-54eb-4551-a711-172f1673ee57): created successfully Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97002d28-bc9c-42be-b646-8e95d367fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:18:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Flow 'volume_create_manager' (d8ba94cc-b18e-486e-8342-d4dad52810fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:18:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e54620f-0174-4c5e-ac64-3635628f079a tempest-AttachVolumeShelveTestJSON-49191510 None] Created volume successfully. Nov 06 21:18:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-5e5e378e-e09d-42b0-8519-c43f17a523f0 req-061248f2-1b0a-4434-b108-477bd057e544 tempest-TaggedAttachmentsTest-339523951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-5e5e378e-e09d-42b0-8519-c43f17a523f0 req-061248f2-1b0a-4434-b108-477bd057e544 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-5e5e378e-e09d-42b0-8519-c43f17a523f0 req-061248f2-1b0a-4434-b108-477bd057e544 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-5e5e378e-e09d-42b0-8519-c43f17a523f0 req-061248f2-1b0a-4434-b108-477bd057e544 tempest-TaggedAttachmentsTest-339523951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a06e1c8f-bcd6-4cf0-937f-0dd93e83b7e0', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:18:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-5e5e378e-e09d-42b0-8519-c43f17a523f0 req-061248f2-1b0a-4434-b108-477bd057e544 tempest-TaggedAttachmentsTest-339523951 None] attachment_update completed successfully. Nov 06 21:18:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-0cb0c60d-1e99-4858-9907-efbe287c4495 req-b66ca0e1-94f3-4d7b-8677-e2b053a720f6 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-0cb0c60d-1e99-4858-9907-efbe287c4495 req-b66ca0e1-94f3-4d7b-8677-e2b053a720f6 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-0cb0c60d-1e99-4858-9907-efbe287c4495 req-b66ca0e1-94f3-4d7b-8677-e2b053a720f6 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-0cb0c60d-1e99-4858-9907-efbe287c4495 req-b66ca0e1-94f3-4d7b-8677-e2b053a720f6 tempest-ServerActionsTestOtherA-404795317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-6aca2942-81a0-4581-90c3-9920117fa8b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcf438f5-a28d-4fe2-abce-5769725f999d', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:18:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-0cb0c60d-1e99-4858-9907-efbe287c4495 req-b66ca0e1-94f3-4d7b-8677-e2b053a720f6 tempest-ServerActionsTestOtherA-404795317 None] attachment_update completed successfully. Nov 06 21:18:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-bd24de8e-56cb-4f91-a1a7-2f4ad248383d req-e78fb095-beb1-4600-b8b1-188cf1b0454e tempest-TaggedAttachmentsTest-339523951 None] Terminate volume connection completed successfully. Nov 06 21:18:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-bd24de8e-56cb-4f91-a1a7-2f4ad248383d req-e78fb095-beb1-4600-b8b1-188cf1b0454e tempest-TaggedAttachmentsTest-339523951 None] Deleting attachment a06e1c8f-bcd6-4cf0-937f-0dd93e83b7e0. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:18:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-c950d01c-3406-4cd1-83ac-734f68d651a7 req-271f2ed0-0e72-4932-92c7-220213de9a37 tempest-AttachVolumeShelveTestJSON-49191510 None] No connector for attachment 0f3ceb93-4d78-4ce5-9dad-19671bda8588; skipping storage backend terminate_connection call. {{(pid=87350) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5082}} Nov 06 21:18:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-c950d01c-3406-4cd1-83ac-734f68d651a7 req-271f2ed0-0e72-4932-92c7-220213de9a37 tempest-AttachVolumeShelveTestJSON-49191510 None] Deleting attachment 0f3ceb93-4d78-4ce5-9dad-19671bda8588. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:18:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-d7d225cd-d781-43ba-9a2c-5c9ba095815b tempest-ServerActionsTestOtherA-404795317 None] Terminate volume connection completed successfully. Nov 06 21:18:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-d7d225cd-d781-43ba-9a2c-5c9ba095815b tempest-ServerActionsTestOtherA-404795317 None] Deleting attachment dcf438f5-a28d-4fe2-abce-5769725f999d. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:18:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-c8fb9f24-91e9-42ad-86bf-e8c6ed8f4654 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-c8fb9f24-91e9-42ad-86bf-e8c6ed8f4654 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-c8fb9f24-91e9-42ad-86bf-e8c6ed8f4654 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-c8fb9f24-91e9-42ad-86bf-e8c6ed8f4654 tempest-ServerActionsTestOtherA-404795317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-6aca2942-81a0-4581-90c3-9920117fa8b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb913857-6924-4faf-bcff-a3bbdce0ffa8', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:18:23 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-228457e3-03c0-458c-b4f9-30b63268ea60 req-c8fb9f24-91e9-42ad-86bf-e8c6ed8f4654 tempest-ServerActionsTestOtherA-404795317 None] attachment_update completed successfully. Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:32 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:18:32 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:32 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.406s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 8 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:18:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:18:33 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=12,cinder:INSERT=1,cinder:SELECT=21 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:33 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=28,cinder:SELECT=45,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Acquiring lock "cinder-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Lock "cinder-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Acquiring lock "cinder-quobyte-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:18:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Lock "cinder-quobyte-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f" acquired by "delete_volume" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:18:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a42001-4fd3-4e34-8999-959908a233dc]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:18:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:35 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f Nov 06 21:18:35 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:35 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f" returned: 0 in 0.747s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:35 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f Nov 06 21:18:35 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:36 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f" returned: 0 in 0.695s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Lock "cinder-quobyte-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f" released by "delete_volume" :: held 1.561s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Created reservations ['1b200b7e-dc0f-44ca-b4f8-d6fd07ccbbbe', '2b7d99b8-370b-4ef1-a046-5977ce2569d9', '2a2f7eba-3864-4639-b0ee-90b9ad9d2b13', '7ab86ad3-3d72-4751-bd0f-198f792005c6'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:18:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:18:36 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:18:36 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:18:37 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 06 21:18:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.590s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:18:37 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:18:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Deleted volume successfully. Nov 06 21:18:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-735e8879-70c7-43f1-bca6-a757091fcfa8 tempest-TaggedAttachmentsTest-339523951 None] Lock "cinder-4874dd8b-01eb-43c9-94e2-1f7ff7a0787f-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:18:46 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:47 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:18:53 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-973efb46-ada0-43d3-997b-134bae1b9dc3 req-b77bbd9f-dcad-41d0-a879-c687bd225c71 tempest-ServerActionsTestOtherA-404795317 None] Terminate volume connection completed successfully. Nov 06 21:18:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-973efb46-ada0-43d3-997b-134bae1b9dc3 req-b77bbd9f-dcad-41d0-a879-c687bd225c71 tempest-ServerActionsTestOtherA-404795317 None] Deleting attachment eb913857-6924-4faf-bcff-a3bbdce0ffa8. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:19:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-021a003e-f962-4e9b-81b6-c9932cce00f4 tempest-GroupSnapshotsTest-1644515408 None] Group tempest-GroupSnapshotsTest-Group-1195379286: creating Nov 06 21:19:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-021a003e-f962-4e9b-81b6-c9932cce00f4 tempest-GroupSnapshotsTest-1644515408 None] Group tempest-GroupSnapshotsTest-Group-1195379286: created successfully Nov 06 21:19:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-021a003e-f962-4e9b-81b6-c9932cce00f4 tempest-GroupSnapshotsTest-1644515408 None] Create group completed successfully. Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Flow 'volume_create_manager' (8e25d178-d574-4d7a-8ea1-ad0ffd2ce7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e04a48-d871-4431-9a9f-498c16ab1a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e04a48-d871-4431-9a9f-498c16ab1a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-464752654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f79724-bff0-4f2a-98b5-1c59d91dd42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a1c305f514e07b7e274af2cca2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:01Z,use_quota=True,user_id='d707962e2b3848d98eaf1e252a93bd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b16d75-d5bd-439c-a422-d6f2e67e2c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b16d75-d5bd-439c-a422-d6f2e67e2c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded7d73a-3540-4121-a307-150cf2124e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:00 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded7d73a-3540-4121-a307-150cf2124e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32f79724-bff0-4f2a-98b5-1c59d91dd42c', 'volume_name': 'volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe916d53-8687-4dc8-8589-98fbfe910599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe916d53-8687-4dc8-8589-98fbfe910599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccbcf80-49bd-4d76-9f49-fb7858edeedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Volume 32f79724-bff0-4f2a-98b5-1c59d91dd42c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Trying to clone 32f79724-bff0-4f2a-98b5-1c59d91dd42c from image 0758c1e7-1e10-4850-a7cc-546025b05acd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:19:01 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[031d50ce-422e-41ec-b071-ceaa55852259]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:01 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD Nov 06 21:19:01 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Flow 'volume_create_manager' (c3243f9a-1ba6-45e2-b216-97374652c9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb10aec5-0c90-4284-ade8-eb3e3cf531bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb10aec5-0c90-4284-ade8-eb3e3cf531bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2086752661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93944fae-4945-4bdb-96ab-326f069862b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdfd68af6cf415ca12cfd20138879a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:02Z,use_quota=True,user_id='f35e02dab2e34372b1b8b138bd3a2acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9f4e49-2a53-4b4e-95f6-8980c7f93bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9f4e49-2a53-4b4e-95f6-8980c7f93bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69cdbe-fdd7-4111-89b3-6d8e7c2f5e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e69cdbe-fdd7-4111-89b3-6d8e7c2f5e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93944fae-4945-4bdb-96ab-326f069862b7', 'volume_name': 'volume-93944fae-4945-4bdb-96ab-326f069862b7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:01 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c9594-6b08-4307-b2e6-0405d11d4a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c9594-6b08-4307-b2e6-0405d11d4a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a36dba-4b46-49d7-89ba-c7620273dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:01 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Volume 93944fae-4945-4bdb-96ab-326f069862b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93944fae-4945-4bdb-96ab-326f069862b7', 'volume_size': 1} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2086752661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93944fae-4945-4bdb-96ab-326f069862b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdfd68af6cf415ca12cfd20138879a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:02Z,use_quota=True,user_id='f35e02dab2e34372b1b8b138bd3a2acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Creating volume 93944fae-4945-4bdb-96ab-326f069862b7 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:01 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:01 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd is fetched for user d707962e2b3848d98eaf1e252a93bd5f. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:19:01 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 1073741824 Nov 06 21:19:01 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6f8a0-769d-4030-bcd4-2d5da52ea2ee]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:02 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD Nov 06 21:19:02 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (ff33704f-6768-4e86-8623-c6b396936978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b5257c-af9f-4e2b-b659-046f2e400819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b5257c-af9f-4e2b-b659-046f2e400819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-83434053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8f0c8e5-c463-476a-a261-cb85a0bf7b3e,host='devstack@QuobyteHD#QuobyteHD',id=13ffc3b7-5957-4e4f-aad4-57b72f27159b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:02Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e20e3d43-fbde-460c-aef5-a2deaec77b13),volume_type_id=e20e3d43-fbde-460c-aef5-a2deaec77b13)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd766218-5ff9-4f74-b4f3-262554561b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd766218-5ff9-4f74-b4f3-262554561b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b286ae-b1b1-4dad-bff4-bfe084a7605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b286ae-b1b1-4dad-bff4-bfe084a7605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ffc3b7-5957-4e4f-aad4-57b72f27159b', 'volume_name': 'volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f012696-89d3-45e4-979d-7c61546fb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f012696-89d3-45e4-979d-7c61546fb883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7bb8f8-5f4b-4c45-889b-52ecb9397a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Volume 13ffc3b7-5957-4e4f-aad4-57b72f27159b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b', 'volume_size': 1} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:02 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 1073741824" returned: 0 in 0.527s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:02 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:02 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 Nov 06 21:19:02 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:02 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8f0c8e5-c463-476a-a261-cb85a0bf7b3e,created_at=2026-11-06T20:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-83434053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8f0c8e5-c463-476a-a261-cb85a0bf7b3e,host='devstack@QuobyteHD#QuobyteHD',id=13ffc3b7-5957-4e4f-aad4-57b72f27159b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:02Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e20e3d43-fbde-460c-aef5-a2deaec77b13),volume_type_id=e20e3d43-fbde-460c-aef5-a2deaec77b13)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Creating volume 13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:02 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:02 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b 1073741824 Nov 06 21:19:02 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a36dba-4b46-49d7-89ba-c7620273dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93944fae-4945-4bdb-96ab-326f069862b7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6cb915-aa74-4a00-aefc-5ae4e7b04ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Volume volume-93944fae-4945-4bdb-96ab-326f069862b7 (93944fae-4945-4bdb-96ab-326f069862b7): created successfully Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6cb915-aa74-4a00-aefc-5ae4e7b04ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Flow 'volume_create_manager' (c3243f9a-1ba6-45e2-b216-97374652c9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-efb0cb36-fceb-4b78-b6b9-8e8a75f6813b tempest-AttachVolumeTestJSON-1640939711 None] Created volume successfully. Nov 06 21:19:03 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b 1073741824" returned: 0 in 0.448s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:03 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b Nov 06 21:19:03 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:03 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b" returned: 0 in 0.260s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-464752654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f79724-bff0-4f2a-98b5-1c59d91dd42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80a1c305f514e07b7e274af2cca2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:01Z,use_quota=True,user_id='d707962e2b3848d98eaf1e252a93bd5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Creating volume 32f79724-bff0-4f2a-98b5-1c59d91dd42c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:03 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:03 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c 1073741824 Nov 06 21:19:03 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7bb8f8-5f4b-4c45-889b-52ecb9397a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df672da-31a6-4ec8-b8a6-b9dac19ff4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Volume volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b (13ffc3b7-5957-4e4f-aad4-57b72f27159b): created successfully Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df672da-31a6-4ec8-b8a6-b9dac19ff4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (ff33704f-6768-4e86-8623-c6b396936978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b61ae80a-3a38-432f-8906-012d348888a8 tempest-GroupSnapshotsTest-1644515408 None] Created volume successfully. Nov 06 21:19:04 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c 1073741824" returned: 0 in 0.492s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:04 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c Nov 06 21:19:04 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:04 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c" returned: 0 in 0.282s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Attempting download of 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 32f79724-bff0-4f2a-98b5-1c59d91dd42c. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4269da-e827-463b-a181-67c24b9d8896]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-af06a424-6e03-4725-bcb7-8ab7328b3cd7 req-09298af1-5d17-400f-aa62-af36949736b5 tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-af06a424-6e03-4725-bcb7-8ab7328b3cd7 req-09298af1-5d17-400f-aa62-af36949736b5 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:04 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse Nov 06 21:19:04 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-af06a424-6e03-4725-bcb7-8ab7328b3cd7 req-09298af1-5d17-400f-aa62-af36949736b5 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-af06a424-6e03-4725-bcb7-8ab7328b3cd7 req-09298af1-5d17-400f-aa62-af36949736b5 tempest-AttachVolumeTestJSON-1640939711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-93944fae-4945-4bdb-96ab-326f069862b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0348f64f-6309-4594-9beb-40dfb474751c', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:19:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-af06a424-6e03-4725-bcb7-8ab7328b3cd7 req-09298af1-5d17-400f-aa62-af36949736b5 tempest-AttachVolumeTestJSON-1640939711 None] attachment_update completed successfully. Nov 06 21:19:04 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse" returned: 0 in 0.458s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:05 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse Nov 06 21:19:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] GroupSnapshot d3871db6-326d-42eb-bac7-4a54946c864c: creating. Nov 06 21:19:05 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Group snapshot d3871db6-326d-42eb-bac7-4a54946c864c: creating. {{(pid=87350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Creating offline snapshot 0a70e531-960b-4cf8-84db-24399542d90c of volume 13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e151af2-9e81-4709-8b72-9bd374a7e969]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:05 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b Nov 06 21:19:05 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:05 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse" returned: 1 in 0.408s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_8napfyse' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da1b31-11b9-40bf-a807-32ff143df55b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:05 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD Nov 06 21:19:05 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:05 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b" returned: 0 in 0.500s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:05 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c 1G Nov 06 21:19:05 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:05 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] 0758c1e7-1e10-4850-a7cc-546025b05acd was qcow2, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:19:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:05 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c Nov 06 21:19:05 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:06 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c 1G" returned: 0 in 0.536s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:06 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c Nov 06 21:19:06 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:06 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c" returned: 0 in 0.343s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:06 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:06 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c Nov 06 21:19:06 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:06 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c" returned: 0 in 0.343s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:06 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info Nov 06 21:19:06 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:07 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info" returned: 0 in 0.351s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:07 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:07 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info Nov 06 21:19:07 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:07 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.info" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-63326ba3-fa6f-4e18-bc07-b2ef90b89079 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot d3871db6-326d-42eb-bac7-4a54946c864c: created successfully Nov 06 21:19:07 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c" returned: 0 in 2.227s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_52ydga0zdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:19:07 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Converted 112.00 MB image at 50.25 MB/s Nov 06 21:19:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:08 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c 1G Nov 06 21:19:08 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:08 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c 1G" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Downloaded image 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 32f79724-bff0-4f2a-98b5-1c59d91dd42c successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd for user d707962e2b3848d98eaf1e252a93bd5f is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Marking volume 32f79724-bff0-4f2a-98b5-1c59d91dd42c as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Copying metadata from image 0758c1e7-1e10-4850-a7cc-546025b05acd to 32f79724-bff0-4f2a-98b5-1c59d91dd42c. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Creating volume glance metadata for volume 32f79724-bff0-4f2a-98b5-1c59d91dd42c backed by image 0758c1e7-1e10-4850-a7cc-546025b05acd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccbcf80-49bd-4d76-9f49-fb7858edeedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a96c9f-9675-4a4b-9815-f4477ec03e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:08 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Volume volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c (32f79724-bff0-4f2a-98b5-1c59d91dd42c): created successfully Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a96c9f-9675-4a4b-9815-f4477ec03e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Flow 'volume_create_manager' (8e25d178-d574-4d7a-8ea1-ad0ffd2ce7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f9cc085f-e434-402f-8c0f-8bfbdcbcb47c tempest-ServerActionsTestOtherA-404795317 None] Created volume successfully. Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-0a70e531-960b-4cf8-84db-24399542d90c-e5741651-c06f-4de6-89eb-797a77684ac1" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-0a70e531-960b-4cf8-84db-24399542d90c-e5741651-c06f-4de6-89eb-797a77684ac1" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Creating volume e5741651-c06f-4de6-89eb-797a77684ac1 from snapshot 0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-e5741651-c06f-4de6-89eb-797a77684ac1" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-e5741651-c06f-4de6-89eb-797a77684ac1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] snapshot: 0a70e531-960b-4cf8-84db-24399542d90c, volume: e5741651-c06f-4de6-89eb-797a77684ac1, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1faece-81ba-49a2-b1e0-06a6a2323656]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:09 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c Nov 06 21:19:09 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:09 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c" returned: 0 in 0.637s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16d11c4-28d5-4b7c-8b5f-96f232aaf15f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:10 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b Nov 06 21:19:10 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:10 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b" returned: 0 in 0.588s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:19:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:19:10 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:19:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:10 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 Nov 06 21:19:10 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-cbf01ef2-73bc-406f-8b19-844d21035e07 req-9f8116a2-f0c5-430d-9d65-9f3cf7155743 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:23 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1" returned: 0 in 12.594s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b, size 1024.00 MB, duration 12.59 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:19:23 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Converted 1024.00 MB image at 81.30 MB/s Nov 06 21:19:23 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:23 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 Nov 06 21:19:23 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:23 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-e5741651-c06f-4de6-89eb-797a77684ac1" released by "_copy_volume_from_snapshot" :: held 14.363s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-0a70e531-960b-4cf8-84db-24399542d90c-e5741651-c06f-4de6-89eb-797a77684ac1" released by "_create_volume_from_snapshot" :: held 14.490s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.520s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-cbf01ef2-73bc-406f-8b19-844d21035e07 req-9f8116a2-f0c5-430d-9d65-9f3cf7155743 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.797s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-cbf01ef2-73bc-406f-8b19-844d21035e07 req-9f8116a2-f0c5-430d-9d65-9f3cf7155743 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-cbf01ef2-73bc-406f-8b19-844d21035e07 req-9f8116a2-f0c5-430d-9d65-9f3cf7155743 tempest-ServerActionsTestOtherA-404795317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c46f1d22-b37e-4715-bd7c-269e377e565f', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:19:24 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-144da219-60bb-4374-93c6-0b721e49a911 tempest-GroupSnapshotsTest-1644515408 None] Create group from source-snapshot-d3871db6-326d-42eb-bac7-4a54946c864c completed successfully. Nov 06 21:19:24 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-cbf01ef2-73bc-406f-8b19-844d21035e07 req-9f8116a2-f0c5-430d-9d65-9f3cf7155743 tempest-ServerActionsTestOtherA-404795317 None] attachment_update completed successfully. Nov 06 21:19:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-e5741651-c06f-4de6-89eb-797a77684ac1" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-e5741651-c06f-4de6-89eb-797a77684ac1" acquired by "delete_volume" :: waited 0.061s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:26 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3705667b-8213-4292-b355-598d94f2eadb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:26 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 Nov 06 21:19:26 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:27 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1" returned: 0 in 0.851s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:27 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1 Nov 06 21:19:27 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:27 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e5741651-c06f-4de6-89eb-797a77684ac1" returned: 0 in 0.394s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-e5741651-c06f-4de6-89eb-797a77684ac1" released by "delete_volume" :: held 1.416s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['5b2005c4-ad84-44c1-a84b-31ef78585e88'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:19:27 devstack cinder-volume[87350]: WARNING cinder.quota [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1004093314 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1004093314, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:19:27 devstack cinder-volume[87350]: WARNING cinder.quota [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1004093314 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1004093314, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['d41299b1-6465-4d9c-9034-c5bc91f261c8', '84bf4c36-723b-478b-90ef-2d5791370870', '83a7a35a-a4f3-4150-800c-aaef4994ce03', '79039f5b-bf04-4893-943c-2c88488bd2f4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:27 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:19:27 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:28 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.329s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:28 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a53cd1e7-9eda-4bc3-9b22-5513b2263a3a tempest-GroupSnapshotsTest-1644515408 None] Delete group completed successfully. Nov 06 21:19:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot d3871db6-326d-42eb-bac7-4a54946c864c: deleting Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot d3871db6-326d-42eb-bac7-4a54946c864c: deleting {{(pid=87350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-13ffc3b7-5957-4e4f-aad4-57b72f27159b" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-13ffc3b7-5957-4e4f-aad4-57b72f27159b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-0a70e531-960b-4cf8-84db-24399542d90c" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-0a70e531-960b-4cf8-84db-24399542d90c" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Deleting offline snapshot 0a70e531-960b-4cf8-84db-24399542d90c of volume 13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] snapshot_file for this snap is: volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a3584c-4dad-4918-86c3-4911f36bf6d6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:29 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c Nov 06 21:19:29 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Acquiring lock "cinder-27339f78-54eb-4551-a711-172f1673ee57-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "cinder-27339f78-54eb-4551-a711-172f1673ee57-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:29 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c" returned: 0 in 0.659s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Acquiring lock "cinder-quobyte-27339f78-54eb-4551-a711-172f1673ee57" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[427476d1-9652-4473-a0b9-419593993f3d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "cinder-quobyte-27339f78-54eb-4551-a711-172f1673ee57" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a94d10a-da24-41e3-8d2f-223bc8d5b6d4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:30 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b Nov 06 21:19:30 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:30 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 Nov 06 21:19:30 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:30 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57" returned: 0 in 0.508s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:30 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57 Nov 06 21:19:30 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:30 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b" returned: 0 in 0.769s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:30 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c Nov 06 21:19:30 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:31 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-27339f78-54eb-4551-a711-172f1673ee57" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "cinder-quobyte-27339f78-54eb-4551-a711-172f1673ee57" released by "delete_volume" :: held 1.055s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Created reservations ['aa78e598-7fa6-45fa-8d46-f1047fc29327', '433c0a3a-6812-468b-bcc1-c7d1125b79dd', '5a44b8c6-38cc-4fb1-92ce-d7a40f9fdc97', '04d07eb8-8089-4a80-928a-0295c5ceb126'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:31 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:19:31 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:31 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c" returned: 0 in 0.616s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:31 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c Nov 06 21:19:31 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:31 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Deleted volume successfully. Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9aebdb91-39ad-4df5-bf5a-17403bf151b5 tempest-AttachVolumeShelveTestJSON-49191510 None] Lock "cinder-27339f78-54eb-4551-a711-172f1673ee57-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:31 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b.0a70e531-960b-4cf8-84db-24399542d90c" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-0a70e531-960b-4cf8-84db-24399542d90c" released by "_delete_snapshot" :: held 2.570s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-13ffc3b7-5957-4e4f-aad4-57b72f27159b" released by "delete_snapshot" :: held 2.631s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:31 devstack cinder-volume[87350]: WARNING cinder.quota [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1004093314 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1004093314, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:19:31 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['d9726aa3-1026-4331-8d51-b79f57da5f77', '47833697-3c75-4a7e-9cba-560b55048da3', '12f788e4-a291-4a02-b604-bf9e59f9441b', '797b7d33-787a-450a-a8d1-e731489a8f11'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:19:32 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6bfcb61c-b870-45e6-84df-60ee4381da39 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot d3871db6-326d-42eb-bac7-4a54946c864c: deleted successfully Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:32 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:19:32 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:32 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.463s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 28 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:19:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:19:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-13ffc3b7-5957-4e4f-aad4-57b72f27159b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-13ffc3b7-5957-4e4f-aad4-57b72f27159b" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[65422a3b-ddff-4170-aebf-eb77016bd185]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b Nov 06 21:19:33 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:33 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b" returned: 0 in 0.492s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:33 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b Nov 06 21:19:33 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:34 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-13ffc3b7-5957-4e4f-aad4-57b72f27159b" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-13ffc3b7-5957-4e4f-aad4-57b72f27159b" released by "delete_volume" :: held 1.020s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['06e89161-f106-4638-a818-0b6a12278cbf'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:19:34 devstack cinder-volume[87350]: WARNING cinder.db.api [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1004093314'] Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['1fd76fae-d9cf-405d-83a3-7b834190ec64', '08559b22-9309-42aa-b654-a5f5c869ec6a', '52db4267-dcdc-4f6f-9404-b20fa361c532', '5a27f1e2-4e37-476a-a0b0-bf3d03ef8f1c'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:34 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:19:34 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:34 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.355s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:34 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:19:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3435ad44-a73b-4e45-9445-e5e5c01612a7 tempest-GroupSnapshotsTest-1644515408 None] Delete group completed successfully. Nov 06 21:19:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0183e99a-cdda-41b2-91a1-e074af304897 tempest-GroupSnapshotsTest-1644515408 None] Group tempest-GroupSnapshotsTest-Group-1400783966: creating Nov 06 21:19:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0183e99a-cdda-41b2-91a1-e074af304897 tempest-GroupSnapshotsTest-1644515408 None] Group tempest-GroupSnapshotsTest-Group-1400783966: created successfully Nov 06 21:19:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0183e99a-cdda-41b2-91a1-e074af304897 tempest-GroupSnapshotsTest-1644515408 None] Create group completed successfully. Nov 06 21:19:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-b52251aa-7c63-40a7-9880-5416bba6901e req-78978d42-a9d8-4b17-8c37-12a72b788cdb tempest-AttachVolumeTestJSON-1640939711 None] Terminate volume connection completed successfully. Nov 06 21:19:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-b52251aa-7c63-40a7-9880-5416bba6901e req-78978d42-a9d8-4b17-8c37-12a72b788cdb tempest-AttachVolumeTestJSON-1640939711 None] Deleting attachment 0348f64f-6309-4594-9beb-40dfb474751c. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (8051e0fd-d424-4675-afcc-bb177b136a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b481d8-3dad-42ee-a297-9b0e2fe1f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b481d8-3dad-42ee-a297-9b0e2fe1f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526843030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d7791f-629d-4bf0-82bd-941f99c51a35,host='devstack@QuobyteHD#QuobyteHD',id=6f36c172-4b0b-40a0-99e1-065da341224d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:39Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca45f50a-380b-4a54-bba3-3946605e3e94),volume_type_id=ca45f50a-380b-4a54-bba3-3946605e3e94)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a55281c-cefe-49ff-8b7e-7dae4bef22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a55281c-cefe-49ff-8b7e-7dae4bef22c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ef1d5c-bca8-4a3b-99af-17e5a83ab14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ef1d5c-bca8-4a3b-99af-17e5a83ab14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f36c172-4b0b-40a0-99e1-065da341224d', 'volume_name': 'volume-6f36c172-4b0b-40a0-99e1-065da341224d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3d47e0-bd62-481e-8474-54b0e7938f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3d47e0-bd62-481e-8474-54b0e7938f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcc4805-4125-443f-9f5c-bdb7d2477085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Volume 6f36c172-4b0b-40a0-99e1-065da341224d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f36c172-4b0b-40a0-99e1-065da341224d', 'volume_size': 1} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06d7791f-629d-4bf0-82bd-941f99c51a35,created_at=2026-11-06T20:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526843030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d7791f-629d-4bf0-82bd-941f99c51a35,host='devstack@QuobyteHD#QuobyteHD',id=6f36c172-4b0b-40a0-99e1-065da341224d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:39Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca45f50a-380b-4a54-bba3-3946605e3e94),volume_type_id=ca45f50a-380b-4a54-bba3-3946605e3e94)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Creating volume 6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:19:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:38 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d 1073741824 Nov 06 21:19:38 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:39 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d 1073741824" returned: 0 in 0.695s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:39 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d Nov 06 21:19:39 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:39 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d" returned: 0 in 0.345s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcc4805-4125-443f-9f5c-bdb7d2477085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f36c172-4b0b-40a0-99e1-065da341224d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1ba120-9a92-4809-9405-3b2c2a35f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:40 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Volume volume-6f36c172-4b0b-40a0-99e1-065da341224d (6f36c172-4b0b-40a0-99e1-065da341224d): created successfully Nov 06 21:19:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1ba120-9a92-4809-9405-3b2c2a35f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (8051e0fd-d424-4675-afcc-bb177b136a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d2795d90-c8a8-43cb-b2b2-a8470c785471 tempest-GroupSnapshotsTest-1644515408 None] Created volume successfully. Nov 06 21:19:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-a60710c5-f634-434d-8004-358babb396e6 req-3c9620ee-981d-438a-accc-58dacd91a59b tempest-ServerActionsTestOtherA-404795317 None] Terminate volume connection completed successfully. Nov 06 21:19:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-a60710c5-f634-434d-8004-358babb396e6 req-3c9620ee-981d-438a-accc-58dacd91a59b tempest-ServerActionsTestOtherA-404795317 None] Deleting attachment c46f1d22-b37e-4715-bd7c-269e377e565f. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (8759f158-f38e-493a-83cc-11d9c85a19aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01f7c42-7cbb-4927-8e80-d45d2a5a17cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01f7c42-7cbb-4927-8e80-d45d2a5a17cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423145832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d7791f-629d-4bf0-82bd-941f99c51a35,host='devstack@QuobyteHD#QuobyteHD',id=a47c6d3c-f954-4efc-8e4f-bcdccac6c908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:41Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca45f50a-380b-4a54-bba3-3946605e3e94),volume_type_id=ca45f50a-380b-4a54-bba3-3946605e3e94)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace9000e-2ac8-4e65-8a1d-df13492e6736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace9000e-2ac8-4e65-8a1d-df13492e6736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1dd908-92cb-44e0-a9aa-6170ebc48b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1dd908-92cb-44e0-a9aa-6170ebc48b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47c6d3c-f954-4efc-8e4f-bcdccac6c908', 'volume_name': 'volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce22110d-04b8-4ea5-81c6-ad1543631fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce22110d-04b8-4ea5-81c6-ad1543631fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa1d5ca-321d-4634-a19d-f15e4392d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Volume a47c6d3c-f954-4efc-8e4f-bcdccac6c908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908', 'volume_size': 1} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06d7791f-629d-4bf0-82bd-941f99c51a35,created_at=2026-11-06T20:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423145832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06d7791f-629d-4bf0-82bd-941f99c51a35,host='devstack@QuobyteHD#QuobyteHD',id=a47c6d3c-f954-4efc-8e4f-bcdccac6c908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:41Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca45f50a-380b-4a54-bba3-3946605e3e94),volume_type_id=ca45f50a-380b-4a54-bba3-3946605e3e94)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Creating volume a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:41 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:19:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:41 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 1073741824 Nov 06 21:19:41 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:42 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 1073741824" returned: 0 in 0.640s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:42 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 Nov 06 21:19:42 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:42 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" returned: 0 in 0.334s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa1d5ca-321d-4634-a19d-f15e4392d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee81722-b947-4512-bcc3-b0d378aa9cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Volume volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 (a47c6d3c-f954-4efc-8e4f-bcdccac6c908): created successfully Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee81722-b947-4512-bcc3-b0d378aa9cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (8759f158-f38e-493a-83cc-11d9c85a19aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ba1be6cd-30b0-41e9-b713-827267d51ef8 tempest-GroupSnapshotsTest-1644515408 None] Created volume successfully. Nov 06 21:19:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-a60710c5-f634-434d-8004-358babb396e6 req-16ce0f1d-b392-4000-bc66-d058a8cdab16 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-a60710c5-f634-434d-8004-358babb396e6 req-16ce0f1d-b392-4000-bc66-d058a8cdab16 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-a60710c5-f634-434d-8004-358babb396e6 req-16ce0f1d-b392-4000-bc66-d058a8cdab16 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-a60710c5-f634-434d-8004-358babb396e6 req-16ce0f1d-b392-4000-bc66-d058a8cdab16 tempest-ServerActionsTestOtherA-404795317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03a250fd-6ba3-473c-bf41-f01ebcf1688b', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:19:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-a60710c5-f634-434d-8004-358babb396e6 req-16ce0f1d-b392-4000-bc66-d058a8cdab16 tempest-ServerActionsTestOtherA-404795317 None] attachment_update completed successfully. Nov 06 21:19:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a7a09ffd-26fd-44f1-9ddb-8227598a8036 tempest-GroupSnapshotsTest-1644515408 None] Update group completed successfully. Nov 06 21:19:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-708a6172-464d-4e11-a892-0a9c6e36a058 tempest-GroupSnapshotsTest-1644515408 None] Update group completed successfully. Nov 06 21:19:46 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=91,cinder:UPDATE=61,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:19:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-714a9b0d-1b44-401c-85cf-30985c603bb6 tempest-GroupSnapshotsTest-1644515408 None] Update group completed successfully. Nov 06 21:19:47 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=87,cinder:UPDATE=70,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:19:47 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:19:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Flow 'volume_create_manager' (ec3dd8a4-18db-4bcc-bd73-9057e256c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9932103-76ed-4264-8c3e-1ea65b1b5e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9932103-76ed-4264-8c3e-1ea65b1b5e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1087182467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6175becc-5d6e-42d0-b208-7dbb431cf3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f2719713a941868afffa6b29441483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:48Z,use_quota=True,user_id='4b18bc03cf7948e290f13a3850dba84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba5ac92-8973-48af-a791-b2afee28147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba5ac92-8973-48af-a791-b2afee28147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d430b81-ccbe-4b65-80ea-cf45fc4d0bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d430b81-ccbe-4b65-80ea-cf45fc4d0bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6175becc-5d6e-42d0-b208-7dbb431cf3f6', 'volume_name': 'volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bb7886-2d75-4e42-8f0c-6f3ebe066c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bb7886-2d75-4e42-8f0c-6f3ebe066c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b9a549-6e6b-4734-8161-6547761558ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:48 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Volume 6175becc-5d6e-42d0-b208-7dbb431cf3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6', 'volume_size': 1} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1087182467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6175becc-5d6e-42d0-b208-7dbb431cf3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6f2719713a941868afffa6b29441483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:19:48Z,use_quota=True,user_id='4b18bc03cf7948e290f13a3850dba84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Creating volume 6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:19:48 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:19:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:48 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 1073741824 Nov 06 21:19:48 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-12498c7d-67fa-4ef7-a6fd-463ccfa94ed5 tempest-GroupSnapshotsTest-1644515408 None] Update group completed successfully. Nov 06 21:19:49 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 1073741824" returned: 0 in 0.886s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:49 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 Nov 06 21:19:49 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:49 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6" returned: 0 in 0.465s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b9a549-6e6b-4734-8161-6547761558ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8f1d64-2c2b-47f4-9b7b-d40a3b24158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:19:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Volume volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 (6175becc-5d6e-42d0-b208-7dbb431cf3f6): created successfully Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8f1d64-2c2b-47f4-9b7b-d40a3b24158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:19:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Flow 'volume_create_manager' (ec3dd8a4-18db-4bcc-bd73-9057e256c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:19:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-18bc1dac-9f99-482e-bfac-3690029e22d8 req-c0cf9388-30c0-4d0e-bbc5-be6ef7711032 tempest-VolumesSnapshotsTestJSON-1533263374 None] Created volume successfully. Nov 06 21:19:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] GroupSnapshot 3446fd21-b766-4506-8fb0-6a7242892d18: creating. Nov 06 21:19:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Group snapshot 3446fd21-b766-4506-8fb0-6a7242892d18: creating. {{(pid=87350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:19:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Creating offline snapshot 56688d26-c63b-43ef-8d54-5e19c12f2251 of volume 6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:19:50 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc11e53f-aaee-4614-be99-cd46d95fcc2b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:50 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d Nov 06 21:19:50 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:51 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d" returned: 0 in 0.769s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:51 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 1G Nov 06 21:19:51 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:51 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 1G" returned: 0 in 0.556s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f36c172-4b0b-40a0-99e1-065da341224d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:52 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f36c172-4b0b-40a0-99e1-065da341224d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 Nov 06 21:19:52 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:52 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f36c172-4b0b-40a0-99e1-065da341224d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251" returned: 0 in 0.431s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:52 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:52 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 Nov 06 21:19:52 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:52 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251" returned: 0 in 0.420s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:52 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info Nov 06 21:19:52 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:53 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info" returned: 0 in 0.278s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:53 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:53 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info Nov 06 21:19:53 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:53 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.info" returned: 0 in 0.264s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.907s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Creating offline snapshot f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 of volume a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d302194a-8a22-4e2e-9229-2bc22ef87902]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:53 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 Nov 06 21:19:53 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:53 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" returned: 0 in 0.386s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:53 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 1G Nov 06 21:19:53 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:54 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 1G" returned: 0 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:54 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 Nov 06 21:19:54 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:54 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" returned: 0 in 0.293s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:54 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:54 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 Nov 06 21:19:54 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:54 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" returned: 0 in 0.256s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:54 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info Nov 06 21:19:54 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:55 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:55 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:55 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info Nov 06 21:19:55 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:55 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.info" returned: 0 in 0.241s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.285s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Creating offline snapshot e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 of volume 6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e857f-c189-454b-9b6f-6bf921ec3413]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:55 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 Nov 06 21:19:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-103ebbd2-6630-421e-a59f-6634dfa3d6bc tempest-GroupSnapshotsTest-1644515408 None] group_snapshot 3446fd21-b766-4506-8fb0-6a7242892d18: created successfully Nov 06 21:19:55 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:55 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6" returned: 0 in 0.450s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:55 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 1G Nov 06 21:19:55 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot 3446fd21-b766-4506-8fb0-6a7242892d18: deleting Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot 3446fd21-b766-4506-8fb0-6a7242892d18: deleting {{(pid=87350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-6f36c172-4b0b-40a0-99e1-065da341224d" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-6f36c172-4b0b-40a0-99e1-065da341224d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-56688d26-c63b-43ef-8d54-5e19c12f2251" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-56688d26-c63b-43ef-8d54-5e19c12f2251" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Deleting offline snapshot 56688d26-c63b-43ef-8d54-5e19c12f2251 of volume 6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] snapshot_file for this snap is: volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f457c-b37a-4b6d-9d5e-bf9cb488fd74]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:56 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 Nov 06 21:19:56 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:56 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 1G" returned: 0 in 0.729s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:56 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 Nov 06 21:19:56 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:56 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251" returned: 0 in 0.461s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f36c172-4b0b-40a0-99e1-065da341224d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[919b6214-7d3d-490b-ba82-1b199fc99e44]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:56 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d Nov 06 21:19:56 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:57 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:57 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 is being set with open permissions: ugo+rw Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:57 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 Nov 06 21:19:57 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:57 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d" returned: 0 in 0.586s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:57 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 Nov 06 21:19:57 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:57 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" returned: 0 in 0.457s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:57 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info Nov 06 21:19:57 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:57 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251" returned: 0 in 0.426s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:57 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251 Nov 06 21:19:57 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:57 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info" returned: 0 in 0.319s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:57 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info is being set with open permissions: ugo+rw Nov 06 21:19:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:57 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info Nov 06 21:19:57 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:58 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.info" returned: 0 in 0.275s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:19:58 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d.56688d26-c63b-43ef-8d54-5e19c12f2251" returned: 0 in 0.358s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-56688d26-c63b-43ef-8d54-5e19c12f2251" released by "_delete_snapshot" :: held 2.000s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-6f36c172-4b0b-40a0-99e1-065da341224d" released by "delete_snapshot" :: held 2.047s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:19:58 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-80894f3a-61dd-4b03-899e-67a00472b516 req-442a2288-d00f-4403-afd2-a6939bdfd1ad tempest-VolumesSnapshotsTestJSON-1533263374 None] Create snapshot completed successfully Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Deleting offline snapshot f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 of volume a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] snapshot_file for this snap is: volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b00a0-973d-4efb-9fe4-707a5fafd02f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:58 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 Nov 06 21:19:58 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "cinder-e8455e8e-b7dd-429a-a6f2-ca6d89cabb56-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-e8455e8e-b7dd-429a-a6f2-ca6d89cabb56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "cinder-quobyte-6175becc-5d6e-42d0-b208-7dbb431cf3f6" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-quobyte-6175becc-5d6e-42d0-b208-7dbb431cf3f6" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "cinder-quobyte-e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-quobyte-e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Deleting offline snapshot e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 of volume 6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] snapshot_file for this snap is: volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d87e5-c9d4-42b3-9a00-48a051f3be72]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:58 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" returned: 0 in 0.479s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[52717324-9cc3-40b7-8e39-115836a2e689]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:58 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 Nov 06 21:19:58 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:58 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 Nov 06 21:19:58 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:59 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" returned: 0 in 0.423s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[968077c3-cc67-4362-bb33-8a1d10a96777]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:59 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" returned: 0 in 0.502s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:59 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 Nov 06 21:19:59 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:59 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 Nov 06 21:19:59 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:59 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" returned: 0 in 0.356s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:59 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7 Nov 06 21:19:59 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:59 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6" returned: 0 in 0.575s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:19:59 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 Nov 06 21:19:59 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:19:59 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Nov 06 21:19:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908.f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" returned: 0 in 0.302s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-f630e2f8-6e72-4d8a-a0ce-7579d96ba9d7" released by "_delete_snapshot" :: held 1.771s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" released by "delete_snapshot" :: held 1.804s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:00 devstack cinder-volume[87350]: WARNING cinder.quota [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-100807526 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-100807526, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:00 devstack cinder-volume[87350]: WARNING cinder.quota [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-100807526 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-100807526, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['b2f80d1d-c6ae-438c-bc14-a2cc2b6e190f', '585ee7a2-6ef4-497d-8801-8411b86fb118', '867319f1-02f7-4636-9333-77e3aaf1fee8', '1ac234aa-d6fc-4d4d-a515-3bcc7b066b09'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:00 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" returned: 0 in 0.465s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:00 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56 Nov 06 21:20:00 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['338f59da-6091-4c43-ac1a-8afd13b56ca3', '1bf83034-396e-4740-8a93-10bdffe9b687', '1eb63259-54d6-45a8-8f8c-0bdfa7b375dd', '13b05e0a-cae0-4daf-bb96-2dfbd05478c6'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:00 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6.e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" returned: 0 in 0.276s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-quobyte-e8455e8e-b7dd-429a-a6f2-ca6d89cabb56" released by "_delete_snapshot" :: held 1.942s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-quobyte-6175becc-5d6e-42d0-b208-7dbb431cf3f6" released by "delete_snapshot" :: held 1.991s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e47430ac-eba7-4ba1-a280-32a440eb9e87 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot 3446fd21-b766-4506-8fb0-6a7242892d18: deleted successfully Nov 06 21:20:00 devstack cinder-volume[87350]: WARNING cinder.quota [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.quota [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Created reservations ['a1383d33-a123-4471-b432-d81fd5a32cb6', '3ae15c33-c405-432d-a9ea-18016bde4c7e', 'd5b1a173-209a-4fe9-9769-4a5fd1e6ec05', '2c4dd72f-dbca-4d6c-9fd1-9a9e9bca5987'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Delete snapshot completed successfully. Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-c84b6f60-2b13-4724-be9a-0b1cdbce94e0 req-7a277595-6409-44bf-8c70-83cae426ebbc tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-e8455e8e-b7dd-429a-a6f2-ca6d89cabb56-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "cinder-6175becc-5d6e-42d0-b208-7dbb431cf3f6-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-6175becc-5d6e-42d0-b208-7dbb431cf3f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "cinder-quobyte-6175becc-5d6e-42d0-b208-7dbb431cf3f6" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-quobyte-6175becc-5d6e-42d0-b208-7dbb431cf3f6" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d5d19-b78e-4340-9505-70dadd27b326]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:01 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 Nov 06 21:20:01 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-6f36c172-4b0b-40a0-99e1-065da341224d" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-6f36c172-4b0b-40a0-99e1-065da341224d" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af17f6e-0a12-4167-93a1-3836c2bc9d6a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:01 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d Nov 06 21:20:01 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:01 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6" returned: 0 in 0.514s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:01 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6 Nov 06 21:20:01 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:01 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6175becc-5d6e-42d0-b208-7dbb431cf3f6" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-quobyte-6175becc-5d6e-42d0-b208-7dbb431cf3f6" released by "delete_volume" :: held 0.886s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:01 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d" returned: 0 in 0.497s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:01 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d Nov 06 21:20:01 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.quota [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Created reservations ['d4020587-7e87-4ab8-b362-107d3a85ce45', 'b586f56e-155f-4f11-9b24-37314acbbb0f', 'b9ed7bb5-cdcb-49d2-94af-259441025481', '545d8df4-53c5-42b3-b48c-e8d8112ab40b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:02 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:02 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:02 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6f36c172-4b0b-40a0-99e1-065da341224d" returned: 0 in 0.332s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-6f36c172-4b0b-40a0-99e1-065da341224d" released by "delete_volume" :: held 0.943s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:02 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.manager [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Deleted volume successfully. Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a37b56-bd94-45cf-8c8f-2539f7b5da99]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-d9ae8b38-d9f2-40d3-a60a-1dbf70fb370b req-7b0fc69c-8f68-4bb3-bfd1-97d58d073c60 tempest-VolumesSnapshotsTestJSON-1533263374 None] Lock "cinder-6175becc-5d6e-42d0-b208-7dbb431cf3f6-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:02 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 Nov 06 21:20:02 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:02 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" returned: 0 in 0.462s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:02 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908 Nov 06 21:20:02 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:03 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" returned: 0 in 0.293s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-a47c6d3c-f954-4efc-8e4f-bcdccac6c908" released by "delete_volume" :: held 0.874s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['1bb03d54-c4a8-4248-8135-95418fbc2af8'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:03 devstack cinder-volume[87350]: WARNING cinder.quota [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-100807526 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-100807526, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['c25e300f-6c0a-4f6a-861b-5963e5268777', 'f44605b8-5cd0-4fb8-b504-f6b066deb424', 'dddac696-51ad-4d86-8e45-029cf4c3d57a', 'bf91aedd-9c86-47ee-975f-7c24375d056f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['d655e02a-78c7-4945-94fd-3163811f7f22', '2526cbcf-f0fe-49ef-bc66-b6d7f0eeecf8', '965a055f-8d0c-4160-9fae-7c3327983535', 'ccc6aaaa-b6d0-4113-a61c-b414ad92f146'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:03 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:03 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:03 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.325s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:03 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cda9b9d4-5a8f-4e3d-8ed0-9b7104476680 tempest-GroupSnapshotsTest-1644515408 None] Delete group completed successfully. Nov 06 21:20:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-77960d69-ca6b-48b5-8500-eec3092112f6 tempest-GroupSnapshotsTest-1644515408 None] Group tempest-GroupSnapshotsTest-Group-222285882: creating Nov 06 21:20:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-77960d69-ca6b-48b5-8500-eec3092112f6 tempest-GroupSnapshotsTest-1644515408 None] Group tempest-GroupSnapshotsTest-Group-222285882: created successfully Nov 06 21:20:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-77960d69-ca6b-48b5-8500-eec3092112f6 tempest-GroupSnapshotsTest-1644515408 None] Create group completed successfully. Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (f52c66ed-51bf-4612-b7c1-f50ca3060910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d01111-2dc3-459f-a3c8-ae52771ab9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d01111-2dc3-459f-a3c8-ae52771ab9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77198723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38cf5627-fed2-4f1e-9c72-c01c89a974b3,host='devstack@QuobyteHD#QuobyteHD',id=ee79c9e2-ec5e-46bb-b645-df00e3de6626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:06Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22f423c5-293d-4614-9584-ad8524fa8223),volume_type_id=22f423c5-293d-4614-9584-ad8524fa8223)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bab551e-28cf-44d6-bfc0-1a2f31e85783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bab551e-28cf-44d6-bfc0-1a2f31e85783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6a5ea0-bbcc-416a-aec7-be4156feaa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6a5ea0-bbcc-416a-aec7-be4156feaa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee79c9e2-ec5e-46bb-b645-df00e3de6626', 'volume_name': 'volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e53b0-537e-4b99-a244-f05b8fb03655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e53b0-537e-4b99-a244-f05b8fb03655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598617ed-b8f3-4658-be50-5c959267fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:06 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Volume ee79c9e2-ec5e-46bb-b645-df00e3de6626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626', 'volume_size': 1} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38cf5627-fed2-4f1e-9c72-c01c89a974b3,created_at=2026-11-06T20:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77198723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38cf5627-fed2-4f1e-9c72-c01c89a974b3,host='devstack@QuobyteHD#QuobyteHD',id=ee79c9e2-ec5e-46bb-b645-df00e3de6626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30cf30348c94a88a1a0319984ba4190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:06Z,use_quota=True,user_id='59133ddc204f4e60860341a3f3ad5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22f423c5-293d-4614-9584-ad8524fa8223),volume_type_id=22f423c5-293d-4614-9584-ad8524fa8223)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Creating volume ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:06 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:06 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 1073741824 Nov 06 21:20:06 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:07 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 1073741824" returned: 0 in 0.647s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:07 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 Nov 06 21:20:07 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Flow 'volume_create_manager' (d864332f-8aad-48b9-b739-06d094410e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b133d-0610-4df4-a949-59ec20d2a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b133d-0610-4df4-a949-59ec20d2a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1928767984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb77777d-3717-4faf-8c9d-87a191594684,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9329e52ef447c3a9067bbdc3098052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:07Z,use_quota=True,user_id='317673a632de40bb8a367e6f502ea903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e4f0d1-ee28-45ea-ac31-584237d34547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e4f0d1-ee28-45ea-ac31-584237d34547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e12c14-5b92-4cee-80be-dda26151efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e12c14-5b92-4cee-80be-dda26151efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb77777d-3717-4faf-8c9d-87a191594684', 'volume_name': 'volume-fb77777d-3717-4faf-8c9d-87a191594684', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2206d9f-dce8-49e1-a777-9ebda672b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2206d9f-dce8-49e1-a777-9ebda672b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b62d68-cb5c-4ce1-93fa-c52a119c8beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Volume fb77777d-3717-4faf-8c9d-87a191594684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb77777d-3717-4faf-8c9d-87a191594684', 'volume_size': 1} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:07 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626" returned: 0 in 0.293s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1928767984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb77777d-3717-4faf-8c9d-87a191594684,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9329e52ef447c3a9067bbdc3098052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:07Z,use_quota=True,user_id='317673a632de40bb8a367e6f502ea903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Creating volume fb77777d-3717-4faf-8c9d-87a191594684 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:07 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598617ed-b8f3-4658-be50-5c959267fc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 1073741824 Nov 06 21:20:07 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff346d82-de52-46ca-a3c7-6d025235abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:07 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Volume volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 (ee79c9e2-ec5e-46bb-b645-df00e3de6626): created successfully Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff346d82-de52-46ca-a3c7-6d025235abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Flow 'volume_create_manager' (f52c66ed-51bf-4612-b7c1-f50ca3060910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a0f2913e-f9e9-4c1e-8d43-560983e310ab tempest-GroupSnapshotsTest-1644515408 None] Created volume successfully. Nov 06 21:20:07 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 1073741824" returned: 0 in 0.554s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:08 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 Nov 06 21:20:08 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:08 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684" returned: 0 in 0.359s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b62d68-cb5c-4ce1-93fa-c52a119c8beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb77777d-3717-4faf-8c9d-87a191594684', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae5370-3f2a-466e-a25d-bde0efc53431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:08 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Volume volume-fb77777d-3717-4faf-8c9d-87a191594684 (fb77777d-3717-4faf-8c9d-87a191594684): created successfully Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ae5370-3f2a-466e-a25d-bde0efc53431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Flow 'volume_create_manager' (d864332f-8aad-48b9-b739-06d094410e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-db2ef473-f813-4cae-a69d-2a4909a0a5ea req-f92a715c-5d30-462b-ab49-2eee8ad80eb5 tempest-VolumesGetTestJSON-787667575 None] Created volume successfully. Nov 06 21:20:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] GroupSnapshot c34eeb64-bdb3-48df-bad3-5f60d8e7a5bc: creating. Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Group snapshot c34eeb64-bdb3-48df-bad3-5f60d8e7a5bc: creating. {{(pid=87350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Creating offline snapshot 355f7173-33dd-464e-94d1-a30903060caf of volume ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6679485a-722b-4216-8699-6875df0e5acc]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:09 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 Nov 06 21:20:09 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:09 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626" returned: 0 in 0.436s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:09 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf 1G Nov 06 21:20:09 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Acquiring lock "cinder-fb77777d-3717-4faf-8c9d-87a191594684-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Lock "cinder-fb77777d-3717-4faf-8c9d-87a191594684-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Acquiring lock "cinder-quobyte-fb77777d-3717-4faf-8c9d-87a191594684" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Lock "cinder-quobyte-fb77777d-3717-4faf-8c9d-87a191594684" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41bfc69-11b6-4760-b43f-552a5d66418d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:09 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 Nov 06 21:20:09 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:09 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf 1G" returned: 0 in 0.576s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf Nov 06 21:20:10 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:10 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684" returned: 0 in 0.454s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684 Nov 06 21:20:10 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:10 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf" returned: 0 in 0.332s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf Nov 06 21:20:10 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:10 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fb77777d-3717-4faf-8c9d-87a191594684" returned: 0 in 0.250s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Lock "cinder-quobyte-fb77777d-3717-4faf-8c9d-87a191594684" released by "delete_volume" :: held 0.768s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:10 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf" returned: 0 in 0.264s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG cinder.quota [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Created reservations ['0d373c1b-34c2-437f-90e4-7ceb3af9277a', '914704ac-9ae9-487d-88e7-28f05f11c143', '85d4d7a9-6463-4f6f-bb4d-b42ff8087244', '18d74a13-b692-47ae-bd7b-5ee544616315'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:10 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info Nov 06 21:20:10 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:10 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:10 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info" returned: 0 in 0.298s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:10 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:20:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:10 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info Nov 06 21:20:10 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:11 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.309s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:11 devstack cinder-volume[87350]: DEBUG cinder.manager [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Deleted volume successfully. Nov 06 21:20:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-613cb7e4-577b-4065-a1f0-6346ab6fdb91 req-b2ce4cfd-d8b2-4d73-b7d2-e7af9653d9a4 tempest-VolumesGetTestJSON-787667575 None] Lock "cinder-fb77777d-3717-4faf-8c9d-87a191594684-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:11 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.info" returned: 0 in 0.311s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ac1d43cb-32ea-4c7f-8b26-7b27233c18b8 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot c34eeb64-bdb3-48df-bad3-5f60d8e7a5bc: created successfully Nov 06 21:20:12 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot c34eeb64-bdb3-48df-bad3-5f60d8e7a5bc: deleting Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot c34eeb64-bdb3-48df-bad3-5f60d8e7a5bc: deleting {{(pid=87350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-ee79c9e2-ec5e-46bb-b645-df00e3de6626" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-ee79c9e2-ec5e-46bb-b645-df00e3de6626" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-355f7173-33dd-464e-94d1-a30903060caf" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-355f7173-33dd-464e-94d1-a30903060caf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Deleting offline snapshot 355f7173-33dd-464e-94d1-a30903060caf of volume ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] snapshot_file for this snap is: volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36ba11-5237-49e5-8146-158f911f1f1a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:12 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf Nov 06 21:20:12 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:12 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf" returned: 0 in 0.446s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[16042aef-ef4b-40ed-be37-10c141d5dbff]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:13 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 Nov 06 21:20:13 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:13 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626" returned: 0 in 0.490s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:13 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf Nov 06 21:20:13 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:13 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf" returned: 0 in 0.480s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:14 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf Nov 06 21:20:14 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:14 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626.355f7173-33dd-464e-94d1-a30903060caf" returned: 0 in 0.361s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-355f7173-33dd-464e-94d1-a30903060caf" released by "_delete_snapshot" :: held 1.914s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-ee79c9e2-ec5e-46bb-b645-df00e3de6626" released by "delete_snapshot" :: held 1.944s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:14 devstack cinder-volume[87350]: WARNING cinder.quota [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2031777220 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2031777220, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:14 devstack cinder-volume[87350]: WARNING cinder.quota [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2031777220 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2031777220, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['c8b3b769-992e-4bf0-a5c1-12ccc3901c91', 'ade42db9-622d-44a0-9ae7-93161c71a356', 'f883e803-2c1f-413e-b635-2be9cd117de5', 'a0f0afb3-e8b3-458c-8207-49c7b2526943'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d9c645e7-b751-4f90-8e49-defada48f3c3 tempest-GroupSnapshotsTest-1644515408 None] group_snapshot c34eeb64-bdb3-48df-bad3-5f60d8e7a5bc: deleted successfully Nov 06 21:20:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "cinder-quobyte-ee79c9e2-ec5e-46bb-b645-df00e3de6626" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-ee79c9e2-ec5e-46bb-b645-df00e3de6626" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:15 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ea0f0c-7c7d-4399-8d1e-dcead1a5b398]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:15 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 Nov 06 21:20:15 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:15 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626" returned: 0 in 0.555s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:15 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626 Nov 06 21:20:15 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:16 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ee79c9e2-ec5e-46bb-b645-df00e3de6626" returned: 0 in 0.276s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Lock "cinder-quobyte-ee79c9e2-ec5e-46bb-b645-df00e3de6626" released by "delete_volume" :: held 0.951s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['3e437ac5-a156-4a22-beaa-ee8473149e81'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:16 devstack cinder-volume[87350]: WARNING cinder.quota [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2031777220 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2031777220, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Created reservations ['78be1f64-52a8-4be7-9309-826870a1c8c7', 'c17188bf-3310-4f5d-9f13-107ca8551041', 'e7902a42-2815-44a3-9a86-752a3a846ce8', 'afa687e4-67e7-4a86-99e1-98c7a957087d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:16 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:16 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:16 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.346s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:16 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1af8858e-898d-4473-af8f-9c1ea624bbb1 tempest-GroupSnapshotsTest-1644515408 None] Delete group completed successfully. Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=84,cinder:UPDATE=87,cinder:INSERT=27,cinder:DELETE=3 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=82,cinder:UPDATE=89,cinder:DELETE=3,cinder:INSERT=18 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:20:32 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:32 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:32 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.563s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 28 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:20:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:20:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-30ea3147-5f34-4264-9762-f9aa16bc505b tempest-ServerActionsTestOtherA-404795317 None] Terminate volume connection completed successfully. Nov 06 21:20:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-30ea3147-5f34-4264-9762-f9aa16bc505b tempest-ServerActionsTestOtherA-404795317 None] Deleting attachment 03a250fd-6ba3-473c-bf41-f01ebcf1688b. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "cinder-32f79724-bff0-4f2a-98b5-1c59d91dd42c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-32f79724-bff0-4f2a-98b5-1c59d91dd42c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "cinder-quobyte-32f79724-bff0-4f2a-98b5-1c59d91dd42c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-quobyte-32f79724-bff0-4f2a-98b5-1c59d91dd42c" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd33ecd9-525f-475c-b17c-59ba30834df3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:34 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c Nov 06 21:20:34 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:34 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c" returned: 0 in 0.639s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:34 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c Nov 06 21:20:34 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:35 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32f79724-bff0-4f2a-98b5-1c59d91dd42c" returned: 0 in 0.489s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-quobyte-32f79724-bff0-4f2a-98b5-1c59d91dd42c" released by "delete_volume" :: held 1.260s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.quota [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Created reservations ['948f94fc-ec92-4b55-b517-157ce632a958', '4365f50c-1bcc-415b-96c1-cacd5f8b22ea', 'cce10d79-9f59-4e56-a556-4246c07e725c', 'de381332-646b-4baf-a07b-da46100793a3'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:35 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:35 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "cinder-6aca2942-81a0-4581-90c3-9920117fa8b7-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-6aca2942-81a0-4581-90c3-9920117fa8b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:35 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.352s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.manager [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Deleted volume successfully. Nov 06 21:20:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "cinder-quobyte-6aca2942-81a0-4581-90c3-9920117fa8b7" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-cdab5294-f899-4934-826f-e3b28f428ee1 req-78e3df60-839c-45d4-b815-c89b131cd82a tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-32f79724-bff0-4f2a-98b5-1c59d91dd42c-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-quobyte-6aca2942-81a0-4581-90c3-9920117fa8b7" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b0f67a-3a00-491f-8e41-c80044dffb33]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:36 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 Nov 06 21:20:36 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:36 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7" returned: 0 in 0.453s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:36 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7 Nov 06 21:20:36 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:36 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6aca2942-81a0-4581-90c3-9920117fa8b7" returned: 0 in 0.303s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-quobyte-6aca2942-81a0-4581-90c3-9920117fa8b7" released by "delete_volume" :: held 0.819s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:36 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Created reservations ['066b814a-5e6f-4972-8492-d75dd8a19801', '0eb661a0-1f3b-47f6-8e6a-4383f9865ef4', 'd98d1247-81f6-4ca3-abf3-78cdd677649e', '3dfac608-fdb9-4463-bf4a-4353a747b32f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:37 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:37 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Flow 'volume_create_manager' (4fbe27e3-9132-4e74-8de2-413e7be196b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e9ee6b-ee7a-4ad7-8694-916780d1b19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e9ee6b-ee7a-4ad7-8694-916780d1b19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1667331819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea087888-3fb5-4dc9-a7b1-1605e5d20c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee70803406a4d6e901fed9774e4452a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:37Z,use_quota=True,user_id='0005897fa2da470e8be160784486001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b5b81b-33e4-4bd5-bd5b-351d3231959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b5b81b-33e4-4bd5-bd5b-351d3231959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80d3854-a7d5-45fd-a0d6-12caa802bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80d3854-a7d5-45fd-a0d6-12caa802bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea087888-3fb5-4dc9-a7b1-1605e5d20c92', 'volume_name': 'volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4729d2-5406-450c-a97d-07ce5567b4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4729d2-5406-450c-a97d-07ce5567b4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201e712f-419f-449f-a5b0-52332d7f1675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Volume ea087888-3fb5-4dc9-a7b1-1605e5d20c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92', 'volume_size': 1} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1667331819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea087888-3fb5-4dc9-a7b1-1605e5d20c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee70803406a4d6e901fed9774e4452a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:37Z,use_quota=True,user_id='0005897fa2da470e8be160784486001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Creating volume ea087888-3fb5-4dc9-a7b1-1605e5d20c92 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:37 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:37 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.400s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Deleted volume successfully. Nov 06 21:20:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3eef4acb-6d51-4e53-b4f3-9ec49dbd8109 tempest-ServerActionsTestOtherA-404795317 None] Lock "cinder-6aca2942-81a0-4581-90c3-9920117fa8b7-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:37 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 1073741824 Nov 06 21:20:37 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Flow 'volume_create_manager' (201c6aa7-0f5b-4ce9-84f6-78406b6605d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e48ac75-9b68-4ffb-98e7-bb0d1d36dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e48ac75-9b68-4ffb-98e7-bb0d1d36dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1036525654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ef9b40-1640-47bd-a206-ff60c3f1ba06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677c3e41d2934f4888a23a441d2e7bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:38Z,use_quota=True,user_id='d4289fee11724042a73cb95061e4dd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ebc0ef-9f37-4b9b-85e2-c21986ad1588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ebc0ef-9f37-4b9b-85e2-c21986ad1588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcff837f-fc77-4772-adef-c00a296a52f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcff837f-fc77-4772-adef-c00a296a52f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ef9b40-1640-47bd-a206-ff60c3f1ba06', 'volume_name': 'volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9d115d-0817-4eab-bd45-8b0fcaefcdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9d115d-0817-4eab-bd45-8b0fcaefcdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adaf7bf8-f58b-420b-be6a-4a843a923fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06', 'volume_size': 1} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:38 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 1073741824" returned: 0 in 0.722s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:38 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 Nov 06 21:20:38 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:38 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92" returned: 0 in 0.262s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1036525654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ef9b40-1640-47bd-a206-ff60c3f1ba06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677c3e41d2934f4888a23a441d2e7bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:38Z,use_quota=True,user_id='d4289fee11724042a73cb95061e4dd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Creating volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201e712f-419f-449f-a5b0-52332d7f1675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 1073741824 Nov 06 21:20:38 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4992a2a2-b8ce-42e7-a371-0878e1608e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Volume volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 (ea087888-3fb5-4dc9-a7b1-1605e5d20c92): created successfully Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4992a2a2-b8ce-42e7-a371-0878e1608e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Flow 'volume_create_manager' (4fbe27e3-9132-4e74-8de2-413e7be196b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e6b9ed13-46ec-4457-bfa2-a8a5e39bbba3 tempest-VolumesServicesTestJSON-721031583 None] Created volume successfully. Nov 06 21:20:39 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 1073741824" returned: 0 in 0.555s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:39 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 Nov 06 21:20:39 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:39 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" returned: 0 in 0.316s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Acquiring lock "cinder-ea087888-3fb5-4dc9-a7b1-1605e5d20c92-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adaf7bf8-f58b-420b-be6a-4a843a923fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41648cf3-682f-4442-8a77-c94d93be4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Lock "cinder-ea087888-3fb5-4dc9-a7b1-1605e5d20c92-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Volume volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 (c6ef9b40-1640-47bd-a206-ff60c3f1ba06): created successfully Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41648cf3-682f-4442-8a77-c94d93be4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Flow 'volume_create_manager' (201c6aa7-0f5b-4ce9-84f6-78406b6605d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0a5367be-6681-4f0f-aa14-4501b3855a44 tempest-SnapshotsActionsTest-754588047 None] Created volume successfully. Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Acquiring lock "cinder-quobyte-ea087888-3fb5-4dc9-a7b1-1605e5d20c92" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Lock "cinder-quobyte-ea087888-3fb5-4dc9-a7b1-1605e5d20c92" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1f5bd-674c-4105-a12a-6f10f563ff6f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:39 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 Nov 06 21:20:39 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:39 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92" returned: 0 in 0.348s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:39 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92 Nov 06 21:20:39 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:40 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea087888-3fb5-4dc9-a7b1-1605e5d20c92" returned: 0 in 0.273s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Lock "cinder-quobyte-ea087888-3fb5-4dc9-a7b1-1605e5d20c92" released by "delete_volume" :: held 0.677s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Created reservations ['f594b857-f8e6-4e36-ad85-f92c38ac91f3', '68cc3232-1225-4438-959a-f52a4b6e39d7', '781796cc-cb5f-4d2c-9cb6-61109cadca27', '497bbb58-0d68-498f-b0ac-0f72c008f25a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Creating offline snapshot b88f96c4-7ebb-41b9-8c61-4e06ae501e82 of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4cb0b-6425-47d1-a6aa-e64fcae36459]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:40 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:40 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:40 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 Nov 06 21:20:40 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:40 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.262s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Deleted volume successfully. Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74e150bb-3038-4e95-b820-54f9f426a511 tempest-VolumesServicesTestJSON-721031583 None] Lock "cinder-ea087888-3fb5-4dc9-a7b1-1605e5d20c92-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:40 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:40 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 1G Nov 06 21:20:40 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:41 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 1G" returned: 0 in 0.502s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:41 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:41 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:41 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.390s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:41 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 is being set with open permissions: ugo+rw Nov 06 21:20:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:41 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:41 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:42 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.327s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:42 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info Nov 06 21:20:42 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:42 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info" returned: 0 in 0.329s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:42 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info is being set with open permissions: ugo+rw Nov 06 21:20:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:42 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info Nov 06 21:20:42 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:42 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.info" returned: 0 in 0.282s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-be6daeb4-007d-4864-8843-2407f6220058 tempest-SnapshotsActionsTest-754588047 None] Create snapshot completed successfully Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Creating offline snapshot 80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab643e-8fe5-4f2f-9f05-9698da8b767f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:44 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:44 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:44 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.400s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:44 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf 1G Nov 06 21:20:44 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:45 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf 1G" returned: 0 in 0.645s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:45 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf Nov 06 21:20:45 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:45 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:45 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf is being set with open permissions: ugo+rw Nov 06 21:20:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:45 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf Nov 06 21:20:45 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:46 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" returned: 0 in 0.359s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a4a97889-a893-40f3-b9dd-d1148a330853 tempest-SnapshotsActionsTest-754588047 None] Create snapshot completed successfully Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Flow 'volume_create_manager' (58318a89-65a2-4c36-962c-b15b8259e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292a49d0-6d7f-44bd-b6c9-2f8481344c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292a49d0-6d7f-44bd-b6c9-2f8481344c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-188107428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e08a19f-5e1a-412f-9262-19185136228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdfd68af6cf415ca12cfd20138879a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:46Z,use_quota=True,user_id='f35e02dab2e34372b1b8b138bd3a2acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01d51df-65fe-445f-b7d0-b5a5e4f8a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01d51df-65fe-445f-b7d0-b5a5e4f8a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb9573a-11d3-4443-b359-3d7e2d184338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb9573a-11d3-4443-b359-3d7e2d184338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e08a19f-5e1a-412f-9262-19185136228d', 'volume_name': 'volume-5e08a19f-5e1a-412f-9262-19185136228d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd44732d-433c-472a-97d4-bd572dcd36ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd44732d-433c-472a-97d4-bd572dcd36ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5af5daf-b90c-4783-ac7e-e10274e9c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:46 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Volume 5e08a19f-5e1a-412f-9262-19185136228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e08a19f-5e1a-412f-9262-19185136228d', 'volume_size': 1} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-188107428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e08a19f-5e1a-412f-9262-19185136228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdfd68af6cf415ca12cfd20138879a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:46Z,use_quota=True,user_id='f35e02dab2e34372b1b8b138bd3a2acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Creating volume 5e08a19f-5e1a-412f-9262-19185136228d {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:46 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:46 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d 1073741824 Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:46 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Deleting offline snapshot 80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] snapshot_file for this snap is: volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6a375d-a6ac-482b-b3b5-51d26a985f27]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:46 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf Nov 06 21:20:46 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:47 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d 1073741824" returned: 0 in 0.649s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" returned: 0 in 0.539s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe8b41c-8b48-43b1-9317-d090ac7a20cb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:47 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d Nov 06 21:20:47 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:47 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:47 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:47 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d" returned: 0 in 0.295s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5af5daf-b90c-4783-ac7e-e10274e9c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e08a19f-5e1a-412f-9262-19185136228d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8176af8e-9591-4555-aa97-5e5900503498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Volume volume-5e08a19f-5e1a-412f-9262-19185136228d (5e08a19f-5e1a-412f-9262-19185136228d): created successfully Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8176af8e-9591-4555-aa97-5e5900503498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Flow 'volume_create_manager' (58318a89-65a2-4c36-962c-b15b8259e726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ab45633a-7073-4165-88fd-95f2d88687fc tempest-AttachVolumeTestJSON-1640939711 None] Created volume successfully. Nov 06 21:20:47 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.473s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:47 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf Nov 06 21:20:47 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:48 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" returned: 0 in 0.443s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:48 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf Nov 06 21:20:48 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:48 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" returned: 0 in 0.284s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf" released by "_delete_snapshot" :: held 1.894s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" released by "delete_snapshot" :: held 1.929s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Created reservations ['546054b7-c3eb-41a1-8f08-cb1777052ffd', 'fa2a716c-c3a1-4d8a-9941-0e1115c1e265', 'b325338e-5cd1-4577-9771-df26aad38df7', 'f39b1054-5553-40c3-a6e5-dc8bc2a32218'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Delete snapshot completed successfully. Nov 06 21:20:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9d9b8762-3921-447a-b496-af6b524a28cd tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-80b7fc64-bfe7-4f7b-acb8-c74b1054b8bf-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Flow 'volume_create_manager' (55a6cd3f-dc3a-4a10-90be-91dcd83a0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc040ff6-a4c7-4781-a7f2-d74b6b282532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc040ff6-a4c7-4781-a7f2-d74b6b282532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1748453644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5962c12e-1cc2-427c-a1d8-0334a301b571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f18f1a5ff244dadbbcb92bbddc2aa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:49Z,use_quota=True,user_id='4e1703da8d2241c8bb894d4aa6bd3d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de41a6b6-e561-409f-a3d0-7acc3ad1f65b),volume_type_id=de41a6b6-e561-409f-a3d0-7acc3ad1f65b)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5235085e-184d-441c-8f4d-3697cd0b46c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5235085e-184d-441c-8f4d-3697cd0b46c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed74423-a2c1-420c-a290-b54bc114a1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed74423-a2c1-420c-a290-b54bc114a1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5962c12e-1cc2-427c-a1d8-0334a301b571', 'volume_name': 'volume-5962c12e-1cc2-427c-a1d8-0334a301b571', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2967b6b-2a4f-4c5d-af50-0c6e6bf7f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2967b6b-2a4f-4c5d-af50-0c6e6bf7f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456b46ae-cbf6-4028-b0db-7007a3c0aaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Volume 5962c12e-1cc2-427c-a1d8-0334a301b571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5962c12e-1cc2-427c-a1d8-0334a301b571', 'volume_size': 1} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1748453644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5962c12e-1cc2-427c-a1d8-0334a301b571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f18f1a5ff244dadbbcb92bbddc2aa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:49Z,use_quota=True,user_id='4e1703da8d2241c8bb894d4aa6bd3d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de41a6b6-e561-409f-a3d0-7acc3ad1f65b),volume_type_id=de41a6b6-e561-409f-a3d0-7acc3ad1f65b)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Creating volume 5962c12e-1cc2-427c-a1d8-0334a301b571 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:49 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:49 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 1073741824 Nov 06 21:20:49 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:49 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 1073741824" returned: 0 in 0.596s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-dbd376e1-7c95-489e-8bc6-ca18bf01de01 req-bf103219-39d9-4724-80e6-ca5bb49ef0f1 tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:49 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 Nov 06 21:20:49 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:50 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571" returned: 0 in 0.338s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-dbd376e1-7c95-489e-8bc6-ca18bf01de01 req-bf103219-39d9-4724-80e6-ca5bb49ef0f1 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.372s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456b46ae-cbf6-4028-b0db-7007a3c0aaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5962c12e-1cc2-427c-a1d8-0334a301b571', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dfe38d-b32c-4bf5-b3a3-d59c686e45b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-dbd376e1-7c95-489e-8bc6-ca18bf01de01 req-bf103219-39d9-4724-80e6-ca5bb49ef0f1 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Volume volume-5962c12e-1cc2-427c-a1d8-0334a301b571 (5962c12e-1cc2-427c-a1d8-0334a301b571): created successfully Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dfe38d-b32c-4bf5-b3a3-d59c686e45b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Flow 'volume_create_manager' (55a6cd3f-dc3a-4a10-90be-91dcd83a0d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-dbd376e1-7c95-489e-8bc6-ca18bf01de01 req-bf103219-39d9-4724-80e6-ca5bb49ef0f1 tempest-AttachVolumeTestJSON-1640939711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-5e08a19f-5e1a-412f-9262-19185136228d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88deb432-a4cf-496c-ab4c-cbb1d23937cb', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:20:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-40661610-9159-4fcc-878b-f92c5900eb4d tempest-VolumeTypesAccessTest-115620125 None] Created volume successfully. Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Creating offline snapshot 33d93fa7-5f43-4a59-8481-94421417885a of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:20:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-dbd376e1-7c95-489e-8bc6-ca18bf01de01 req-bf103219-39d9-4724-80e6-ca5bb49ef0f1 tempest-AttachVolumeTestJSON-1640939711 None] attachment_update completed successfully. Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b1c1c6-4927-49c2-880a-e6f66b09079c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:50 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:50 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:50 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.468s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:50 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a 1G Nov 06 21:20:50 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Acquiring lock "cinder-5962c12e-1cc2-427c-a1d8-0334a301b571-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Lock "cinder-5962c12e-1cc2-427c-a1d8-0334a301b571-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Acquiring lock "cinder-quobyte-5962c12e-1cc2-427c-a1d8-0334a301b571" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Lock "cinder-quobyte-5962c12e-1cc2-427c-a1d8-0334a301b571" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087cbe1-36e5-47f6-a3be-d8a342dcc3b5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:51 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a 1G" returned: 0 in 0.651s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:51 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 Nov 06 21:20:51 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:51 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a Nov 06 21:20:51 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:51 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571" returned: 0 in 0.496s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:51 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571 Nov 06 21:20:51 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:52 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:52 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a is being set with open permissions: ugo+rw Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:52 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a Nov 06 21:20:52 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:52 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5962c12e-1cc2-427c-a1d8-0334a301b571" returned: 0 in 0.328s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Lock "cinder-quobyte-5962c12e-1cc2-427c-a1d8-0334a301b571" released by "delete_volume" :: held 0.877s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:52 devstack cinder-volume[87350]: WARNING cinder.quota [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1941731459 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1941731459, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:52 devstack cinder-volume[87350]: WARNING cinder.quota [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1941731459 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1941731459, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:20:52 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a" returned: 0 in 0.406s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Created reservations ['be23b3f5-3404-4b54-9071-8f5f0ce09d36', '231a4a64-7fd9-479f-8f7a-8ee302144682', '5b63a9a6-468d-4952-aca3-349afc72e108', '8142fd3e-f1a4-4806-a050-0ef65c4b1c4a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e9c5d2d5-1377-47f3-ae7a-b29186cd8c05 tempest-SnapshotsActionsTest-754588047 None] Create snapshot completed successfully Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:52 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:20:52 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Flow 'volume_create_manager' (27cae32c-f170-4368-9cf3-d88aa915e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872234c3-43ab-4d62-811d-17df083068f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872234c3-43ab-4d62-811d-17df083068f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1194429012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdfd68af6cf415ca12cfd20138879a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:53Z,use_quota=True,user_id='f35e02dab2e34372b1b8b138bd3a2acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c43d0f1-8745-44aa-b037-3ec4cfd8a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c43d0f1-8745-44aa-b037-3ec4cfd8a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca4399f-7330-48c4-8cd5-e8da3dc9c36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca4399f-7330-48c4-8cd5-e8da3dc9c36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac', 'volume_name': 'volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33273a3-a189-410b-8f35-1cab50f3b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33273a3-a189-410b-8f35-1cab50f3b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5d89c7-8bcd-449d-871a-9d59caef0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Volume b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac', 'volume_size': 1} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1194429012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdfd68af6cf415ca12cfd20138879a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:20:53Z,use_quota=True,user_id='f35e02dab2e34372b1b8b138bd3a2acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Creating volume b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:20:52 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:52 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac 1073741824 Nov 06 21:20:52 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:52 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.267s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:20:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Deleted volume successfully. Nov 06 21:20:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82f42e96-94e0-4d3f-b524-bc55be27491e tempest-VolumeTypesAccessTest-115620125 None] Lock "cinder-5962c12e-1cc2-427c-a1d8-0334a301b571-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:53 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac 1073741824" returned: 0 in 0.519s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:53 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac Nov 06 21:20:53 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:53 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac" returned: 0 in 0.266s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5d89c7-8bcd-449d-871a-9d59caef0814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137cf5c9-f667-45fe-8a7d-e4024f40a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:20:53 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Volume volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac (b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac): created successfully Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137cf5c9-f667-45fe-8a7d-e4024f40a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Flow 'volume_create_manager' (27cae32c-f170-4368-9cf3-d88aa915e488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:20:53 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-681512a0-7508-42cd-9abf-029a7ad376a6 tempest-AttachVolumeTestJSON-1640939711 None] Created volume successfully. Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-33d93fa7-5f43-4a59-8481-94421417885a-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-33d93fa7-5f43-4a59-8481-94421417885a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-33d93fa7-5f43-4a59-8481-94421417885a" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-33d93fa7-5f43-4a59-8481-94421417885a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Deleting offline snapshot 33d93fa7-5f43-4a59-8481-94421417885a of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] snapshot_file for this snap is: volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39bba58-c42d-47a7-be0e-1ed90449ae26]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:53 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a Nov 06 21:20:53 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:54 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a" returned: 0 in 0.565s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80cc79e-c48a-4ced-a9f8-57c06ebfb558]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:54 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:54 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:55 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.584s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:55 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a Nov 06 21:20:55 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:55 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a" returned: 0 in 0.545s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:55 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a Nov 06 21:20:55 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-ded12c16-8b94-4a84-bbe2-395583ef8ce5 req-47c75804-b067-45bd-b308-880cecf0806a tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-ded12c16-8b94-4a84-bbe2-395583ef8ce5 req-47c75804-b067-45bd-b308-880cecf0806a tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-ded12c16-8b94-4a84-bbe2-395583ef8ce5 req-47c75804-b067-45bd-b308-880cecf0806a tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-ded12c16-8b94-4a84-bbe2-395583ef8ce5 req-47c75804-b067-45bd-b308-880cecf0806a tempest-AttachVolumeTestJSON-1640939711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51a611cf-facc-4942-aac8-a68d2114bfac', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:20:55 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.33d93fa7-5f43-4a59-8481-94421417885a" returned: 0 in 0.305s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-ded12c16-8b94-4a84-bbe2-395583ef8ce5 req-47c75804-b067-45bd-b308-880cecf0806a tempest-AttachVolumeTestJSON-1640939711 None] attachment_update completed successfully. Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-33d93fa7-5f43-4a59-8481-94421417885a" released by "_delete_snapshot" :: held 2.143s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" released by "delete_snapshot" :: held 2.167s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:56 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Created reservations ['c534f7d0-bdad-40b7-a7c8-b9a9882f8c39', '2c3692c7-9bfa-4c5c-aeb0-c29e4c39bf0f', '36906624-5c31-4d20-a119-06cb2afef3bc', '1c99df14-62fa-4650-b51d-e0d7ad48b31d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:20:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Delete snapshot completed successfully. Nov 06 21:20:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce225016-1519-4ff4-8197-5dfa58b1361a tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-33d93fa7-5f43-4a59-8481-94421417885a-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:20:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:20:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:20:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Creating offline snapshot b6344c72-a621-49f4-9055-7e435181a11f of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:20:57 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983f6ba-a436-416d-a123-cb18be1879d8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:20:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:57 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:20:57 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:58 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.560s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:20:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:58 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f 1G Nov 06 21:20:58 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:58 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f 1G" returned: 0 in 0.638s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:58 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f Nov 06 21:20:58 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:58 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-8249e3e6-5acc-43a0-a0ab-ef70ebdfae52 req-de411ed2-1180-4dba-be0b-98432560d0f3 tempest-AttachVolumeTestJSON-1640939711 None] Terminate volume connection completed successfully. Nov 06 21:20:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-8249e3e6-5acc-43a0-a0ab-ef70ebdfae52 req-de411ed2-1180-4dba-be0b-98432560d0f3 tempest-AttachVolumeTestJSON-1640939711 None] Deleting attachment 88deb432-a4cf-496c-ab4c-cbb1d23937cb. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:20:59 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f" returned: 0 in 0.437s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:59 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f is being set with open permissions: ugo+rw Nov 06 21:20:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:20:59 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f Nov 06 21:20:59 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:20:59 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Nov 06 21:20:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f" returned: 0 in 0.325s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:20:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:20:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c621e071-bc78-40c8-9c4f-9cabadcc0d47 tempest-SnapshotsActionsTest-754588047 None] Create snapshot completed successfully Nov 06 21:21:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-f7ff9a31-0117-4d4a-864b-3025710f8515 req-f3762b47-1957-4a73-b3aa-8408bc4e2850 tempest-AttachVolumeTestJSON-1640939711 None] Terminate volume connection completed successfully. Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-f7ff9a31-0117-4d4a-864b-3025710f8515 req-f3762b47-1957-4a73-b3aa-8408bc4e2850 tempest-AttachVolumeTestJSON-1640939711 None] Deleting attachment 51a611cf-facc-4942-aac8-a68d2114bfac. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-b6344c72-a621-49f4-9055-7e435181a11f-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-b6344c72-a621-49f4-9055-7e435181a11f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-b6344c72-a621-49f4-9055-7e435181a11f" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-b6344c72-a621-49f4-9055-7e435181a11f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Deleting offline snapshot b6344c72-a621-49f4-9055-7e435181a11f of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] snapshot_file for this snap is: volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb036e-f842-4234-80a2-1e14d85d45b4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:01 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f Nov 06 21:21:01 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:01 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f" returned: 0 in 0.529s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb81f2-8700-453f-b7b7-aca6918228ec]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:01 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:21:01 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:02 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.550s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:02 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f Nov 06 21:21:02 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:02 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f" returned: 0 in 0.638s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:02 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f Nov 06 21:21:02 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:03 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b6344c72-a621-49f4-9055-7e435181a11f" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-b6344c72-a621-49f4-9055-7e435181a11f" released by "_delete_snapshot" :: held 2.215s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" released by "delete_snapshot" :: held 2.256s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Created reservations ['089a949b-6863-4a99-b431-be72c69304d3', '87a3db18-8d6c-4f92-ac8e-0de4bdcefcfc', 'c5615044-961b-41be-b63c-bcac2a2ad413', 'ecc08e5c-ad7f-4ef7-aad6-0481dd9900d7'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Delete snapshot completed successfully. Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce9508a-0b5f-4984-9f04-c7efb01d8135 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-b6344c72-a621-49f4-9055-7e435181a11f-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Flow 'volume_create_manager' (794870a2-eb36-4060-b6a9-bd8bcd21d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33d4827-02e1-4464-a041-7811f64c2734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33d4827-02e1-4464-a041-7811f64c2734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1724961711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b68db6-5aab-4b4a-8ae4-6b3a3670548c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394029474c7b4bc695d0191dfd41beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:03Z,use_quota=True,user_id='e1653cbb61354c30ad9c175350d07930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7def55c4-ac2b-409e-9a6b-98520c4f7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7def55c4-ac2b-409e-9a6b-98520c4f7318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7647e0-f6c9-4a63-a821-83c090e7ffa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7647e0-f6c9-4a63-a821-83c090e7ffa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b68db6-5aab-4b4a-8ae4-6b3a3670548c', 'volume_name': 'volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cb7ee5-0304-42b1-85fe-fd5df0492fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cb7ee5-0304-42b1-85fe-fd5df0492fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce78782e-020f-4fec-b4c0-41a5b7d5e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Volume 36b68db6-5aab-4b4a-8ae4-6b3a3670548c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c', 'volume_size': 1} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1724961711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b68db6-5aab-4b4a-8ae4-6b3a3670548c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394029474c7b4bc695d0191dfd41beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:03Z,use_quota=True,user_id='e1653cbb61354c30ad9c175350d07930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Creating volume 36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:03 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:03 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c 1073741824 Nov 06 21:21:03 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:04 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c 1073741824" returned: 0 in 0.740s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:04 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c Nov 06 21:21:04 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:04 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" returned: 0 in 0.331s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.136s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce78782e-020f-4fec-b4c0-41a5b7d5e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23a253d-8476-441e-b5c9-8290df2a1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Creating offline snapshot c83aa688-dc23-46f6-a33e-537233e7b1b7 of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:04 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Volume volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c (36b68db6-5aab-4b4a-8ae4-6b3a3670548c): created successfully Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23a253d-8476-441e-b5c9-8290df2a1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Flow 'volume_create_manager' (794870a2-eb36-4060-b6a9-bd8bcd21d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c34f6-90e4-41b4-80cf-6d84fa343fa7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a0dc605b-92f4-4fc1-b312-91206ab3e9f4 tempest-SnapshotMetadataTestJSON-1383134337 None] Created volume successfully. Nov 06 21:21:05 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:21:05 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:05 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.391s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:05 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 1G Nov 06 21:21:05 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:05 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 1G" returned: 0 in 0.574s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:05 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 Nov 06 21:21:05 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:06 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7" returned: 0 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:06 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 is being set with open permissions: ugo+rw Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:06 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 Nov 06 21:21:06 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:06 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.743s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Creating offline snapshot 5f32df3c-1f0f-4304-98a2-efac5fbe332d of volume 36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:06 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5838661c-8bdb-4b6e-bdc9-c240990b31cf tempest-SnapshotsActionsTest-754588047 None] Create snapshot completed successfully Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5ded7a-38b2-4f8b-97ed-8966db4fac85]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:06 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c Nov 06 21:21:06 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-c83aa688-dc23-46f6-a33e-537233e7b1b7-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-c83aa688-dc23-46f6-a33e-537233e7b1b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Acquiring lock "cinder-quobyte-c83aa688-dc23-46f6-a33e-537233e7b1b7" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c83aa688-dc23-46f6-a33e-537233e7b1b7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Deleting offline snapshot c83aa688-dc23-46f6-a33e-537233e7b1b7 of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] snapshot_file for this snap is: volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f77b5c-b2aa-4066-af0a-e8a2714b81e1]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:07 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" returned: 0 in 0.509s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:07 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d 1G Nov 06 21:21:07 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:07 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 Nov 06 21:21:07 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "cinder-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "cinder-quobyte-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-quobyte-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:07 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7" returned: 0 in 0.549s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a53ea9-d0d3-4341-86d1-d3732fcfd270]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[730681d9-f357-4c1c-9a01-bbe798aa6954]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:07 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d 1G" returned: 0 in 0.623s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:07 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d Nov 06 21:21:07 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:07 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac Nov 06 21:21:07 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:07 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:21:07 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:08 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d" returned: 0 in 0.430s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:08 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d is being set with open permissions: ugo+rw Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d Nov 06 21:21:08 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:08 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.563s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:08 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac" returned: 0 in 0.600s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 Nov 06 21:21:08 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:08 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac Nov 06 21:21:08 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:08 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d" returned: 0 in 0.342s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac" returned: 0 in 0.336s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:08 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info Nov 06 21:21:08 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-quobyte-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac" released by "delete_volume" :: held 1.028s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Created reservations ['47161b61-6910-423a-b1d1-c2bdf8ae506a', '967a3e92-ad67-4717-afd9-5225234496e4', 'fd62fffa-b48b-4779-ab2b-72536b94eee7', '7c1fae9c-e704-4482-bd9c-a151071b7a38'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:08 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:08 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7" returned: 0 in 0.675s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:08 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7 Nov 06 21:21:08 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:09 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info" returned: 0 in 0.439s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:09 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info is being set with open permissions: ugo+rw Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:09 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info Nov 06 21:21:09 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:09 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.317s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Deleted volume successfully. Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cd744c11-6d93-456f-9162-40a2668f43ea tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-b1c60a4c-3206-4fd8-80ec-ad0fd10c7cac-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:09 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.c83aa688-dc23-46f6-a33e-537233e7b1b7" returned: 0 in 0.340s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c83aa688-dc23-46f6-a33e-537233e7b1b7" released by "_delete_snapshot" :: held 2.300s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" released by "delete_snapshot" :: held 2.338s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Created reservations ['4c52734c-c3a8-498c-9a9f-6be92c31dadf', 'e01fc0e6-18ce-4d42-9a5a-a71c44ed3846', '3e5f9081-eb22-40ed-b73f-594945e99175', 'fbd154d2-a7a0-43da-b2d1-5a08edbccdf8'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:09 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.info" returned: 0 in 0.430s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-31038f1a-0b7a-48b6-b2c2-73b782d1f58b tempest-SnapshotMetadataTestJSON-1383134337 None] Create snapshot completed successfully Nov 06 21:21:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Delete snapshot completed successfully. Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-363b0cd3-9df9-4b82-9ee7-ff95c042f8c0 tempest-SnapshotsActionsTest-1161052134 None] Lock "cinder-c83aa688-dc23-46f6-a33e-537233e7b1b7-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "cinder-5e08a19f-5e1a-412f-9262-19185136228d-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-5e08a19f-5e1a-412f-9262-19185136228d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "cinder-quobyte-5e08a19f-5e1a-412f-9262-19185136228d" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-quobyte-5e08a19f-5e1a-412f-9262-19185136228d" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[624813a2-e740-414a-b0c3-9f0f0e293c00]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:10 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d Nov 06 21:21:10 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:10 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d" returned: 0 in 0.502s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:10 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d Nov 06 21:21:10 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:10 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5e08a19f-5e1a-412f-9262-19185136228d" returned: 0 in 0.321s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-quobyte-5e08a19f-5e1a-412f-9262-19185136228d" released by "delete_volume" :: held 0.892s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Created reservations ['212b58dd-23a6-4c4a-8d70-d0d8d6a602a1', '0936ce17-63e9-4243-8a18-d23883769d62', 'caa5b95e-6bac-43c2-b6c1-f46cc02d8a7d', '1690b93a-4747-4e06-91fe-aa117ced5c6e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "cinder-b88f96c4-7ebb-41b9-8c61-4e06ae501e82-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-b88f96c4-7ebb-41b9-8c61-4e06ae501e82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "cinder-quobyte-b88f96c4-7ebb-41b9-8c61-4e06ae501e82" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-quobyte-b88f96c4-7ebb-41b9-8c61-4e06ae501e82" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Deleting offline snapshot b88f96c4-7ebb-41b9-8c61-4e06ae501e82 of volume c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:11 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:11 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] snapshot_file for this snap is: volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d4d3b-af4b-41a1-9867-8857bc1ceb5f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:21:11 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "cinder-5f32df3c-1f0f-4304-98a2-efac5fbe332d-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.348s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Deleted volume successfully. Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-5f32df3c-1f0f-4304-98a2-efac5fbe332d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "cinder-quobyte-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ca8d0105-2dc3-4680-ae40-3e73623a2a3d tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-5e08a19f-5e1a-412f-9262-19185136228d-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-quobyte-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "cinder-quobyte-5f32df3c-1f0f-4304-98a2-efac5fbe332d" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-quobyte-5f32df3c-1f0f-4304-98a2-efac5fbe332d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Deleting offline snapshot 5f32df3c-1f0f-4304-98a2-efac5fbe332d of volume 36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] snapshot_file for this snap is: volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[591964fc-2d80-4d72-9aa9-43bb9d645587]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.500s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:11 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d Nov 06 21:21:11 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d397e0f0-9936-4f27-aea0-9f1e033525c3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:11 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 Nov 06 21:21:11 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:11 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d" returned: 0 in 0.399s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[691ba7ac-96a2-4414-be0e-74652d136316]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" returned: 0 in 0.425s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:21:12 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:12 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c Nov 06 21:21:12 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "cinder-93944fae-4945-4bdb-96ab-326f069862b7-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-93944fae-4945-4bdb-96ab-326f069862b7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "cinder-quobyte-93944fae-4945-4bdb-96ab-326f069862b7" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-quobyte-93944fae-4945-4bdb-96ab-326f069862b7" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:12 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" returned: 0 in 0.797s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc46ca1-9137-4555-b13b-a3e5f9869c61]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:12 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d Nov 06 21:21:12 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:12 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 Nov 06 21:21:12 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:12 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.919s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:13 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82 Nov 06 21:21:13 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:13 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d" returned: 0 in 0.751s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:13 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:13 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d Nov 06 21:21:13 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7" returned: 0 in 0.790s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:13 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06.b88f96c4-7ebb-41b9-8c61-4e06ae501e82" returned: 0 in 0.623s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:13 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7 Nov 06 21:21:13 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-quobyte-b88f96c4-7ebb-41b9-8c61-4e06ae501e82" released by "_delete_snapshot" :: held 2.682s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" released by "delete_snapshot" :: held 2.738s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Created reservations ['8071bd56-a3dd-4bf5-826f-96550e581884', 'ac946459-a5c7-47ad-ac9a-8aebdeadd001', '770dbfb8-f5cb-4e9f-8045-d4aeb171ace4', 'fc38eec9-2427-459f-b0bf-be4ea0604dbc'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Delete snapshot completed successfully. Nov 06 21:21:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6131a60c-007a-4a0f-9eec-517bb484b762 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-b88f96c4-7ebb-41b9-8c61-4e06ae501e82-delete_snapshot" released by "delete_snapshot" :: held 2.998s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:14 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-93944fae-4945-4bdb-96ab-326f069862b7" returned: 0 in 0.419s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:14 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c.5f32df3c-1f0f-4304-98a2-efac5fbe332d" returned: 0 in 0.498s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-quobyte-93944fae-4945-4bdb-96ab-326f069862b7" released by "delete_volume" :: held 1.306s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-quobyte-5f32df3c-1f0f-4304-98a2-efac5fbe332d" released by "_delete_snapshot" :: held 2.617s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-quobyte-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" released by "delete_snapshot" :: held 2.642s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Created reservations ['fb616535-7a04-4030-9004-d11c3bd2fce8', '724f6c2c-e4fd-4ef3-92da-de22ef89a86e', '89792ee8-212a-4d6b-9031-32b901d4e865', '3b971d67-5c2c-4e16-b85e-06b9b193583c'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Created reservations ['9f730534-393b-4e2a-9af4-b99e30635698', 'f43510d7-8a90-4ce6-a858-6ea682048f0c', '10f7bc07-f475-49bd-8cea-5932f4b6bc01', 'ceab1b6d-337d-4d76-88bb-eb1d295bc9bf'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:14 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:14 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Delete snapshot completed successfully. Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5acdd823-19ea-4cf4-be80-256dc07fc15e tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-5f32df3c-1f0f-4304-98a2-efac5fbe332d-delete_snapshot" released by "delete_snapshot" :: held 3.056s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "cinder-c6ef9b40-1640-47bd-a206-ff60c3f1ba06-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-c6ef9b40-1640-47bd-a206-ff60c3f1ba06-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:14 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.397s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Deleted volume successfully. Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6782ca3-9e62-4e84-8e92-6603a02b8590]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea6003f1-04d8-4b2a-90e1-958d474c70bc tempest-AttachVolumeTestJSON-1640939711 None] Lock "cinder-93944fae-4945-4bdb-96ab-326f069862b7-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "cinder-36b68db6-5aab-4b4a-8ae4-6b3a3670548c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-36b68db6-5aab-4b4a-8ae4-6b3a3670548c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "cinder-quobyte-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-quobyte-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:14 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 Nov 06 21:21:14 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d15e3f5-46bc-467b-8766-b940c5f1ab66]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:15 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c Nov 06 21:21:15 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:15 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" returned: 0 in 0.645s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:15 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06 Nov 06 21:21:15 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:15 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" returned: 0 in 0.650s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:15 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c Nov 06 21:21:15 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:15 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" returned: 0 in 0.350s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-quobyte-c6ef9b40-1640-47bd-a206-ff60c3f1ba06" released by "delete_volume" :: held 1.107s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:15 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Created reservations ['7b56c0ec-d31e-4f8d-9e98-105c62c0a32e', '5c41945c-5c88-4e6c-88ba-da60de9059bd', '2f92d27e-8168-438e-bbae-7d32d705ec3b', '1b6001fa-a9ac-43a9-9c77-c5c3675a41f0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:16 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" returned: 0 in 0.469s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-quobyte-36b68db6-5aab-4b4a-8ae4-6b3a3670548c" released by "delete_volume" :: held 1.235s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:16 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:16 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Created reservations ['7fe16c09-e9c6-444a-8d7d-fe17384cc726', '31abfd98-6eca-4c58-8935-fa23cfaff775', '6ad18f8c-269b-481b-8b23-879c13008892', '284333db-15ec-43a3-ade8-63ba237378b0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:16 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:16 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:16 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.551s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Deleted volume successfully. Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c8a9a785-563d-4217-9e7d-2842a089b0c4 tempest-SnapshotsActionsTest-754588047 None] Lock "cinder-c6ef9b40-1640-47bd-a206-ff60c3f1ba06-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:16 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.507s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Deleted volume successfully. Nov 06 21:21:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-90c78574-01bc-456b-b4e3-b9fe34f0ff96 tempest-SnapshotMetadataTestJSON-1383134337 None] Lock "cinder-36b68db6-5aab-4b4a-8ae4-6b3a3670548c-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Flow 'volume_create_manager' (affc3416-551e-48de-9b51-583b5b9abbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85ccfc3-5e7c-4c6b-9143-4d9a073f4d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85ccfc3-5e7c-4c6b-9143-4d9a073f4d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-956390426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742e51da-01c1-4b8b-9c03-72dc2ed26439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19336318ced4d2fbd3c8c95c514fa5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:26Z,use_quota=True,user_id='4b56e8ed88ba462babf5ed79977a73f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f57e01-2112-4af7-9bc4-dca1737e4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f57e01-2112-4af7-9bc4-dca1737e4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b876b0f9-a8fe-4896-9991-66528531e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b876b0f9-a8fe-4896-9991-66528531e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742e51da-01c1-4b8b-9c03-72dc2ed26439', 'volume_name': 'volume-742e51da-01c1-4b8b-9c03-72dc2ed26439', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d65d18-de7f-4b3a-acb8-322a1d0c4acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d65d18-de7f-4b3a-acb8-322a1d0c4acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b602b7-30cf-4232-9188-d1ab478efe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Volume 742e51da-01c1-4b8b-9c03-72dc2ed26439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742e51da-01c1-4b8b-9c03-72dc2ed26439', 'volume_size': 1} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-956390426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742e51da-01c1-4b8b-9c03-72dc2ed26439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19336318ced4d2fbd3c8c95c514fa5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:26Z,use_quota=True,user_id='4b56e8ed88ba462babf5ed79977a73f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Creating volume 742e51da-01c1-4b8b-9c03-72dc2ed26439 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:26 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 1073741824 Nov 06 21:21:26 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:26 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 1073741824" returned: 0 in 0.710s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:26 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 Nov 06 21:21:26 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:27 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439" returned: 0 in 0.271s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b602b7-30cf-4232-9188-d1ab478efe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742e51da-01c1-4b8b-9c03-72dc2ed26439', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fc799d-fc9e-4211-be68-34625f0e7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Volume volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 (742e51da-01c1-4b8b-9c03-72dc2ed26439): created successfully Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fc799d-fc9e-4211-be68-34625f0e7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Flow 'volume_create_manager' (affc3416-551e-48de-9b51-583b5b9abbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-92b41cd7-7f0e-4161-8164-f97eaf88f80c tempest-AbsoluteLimitsTests-512017770 None] Created volume successfully. Nov 06 21:21:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b5372562-6932-4a29-92be-47d4ef65a8a1 tempest-GroupSnapshotsV319Test-2102769450 None] Group tempest-GroupSnapshotsV319Test-Group-1560450909: creating Nov 06 21:21:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b5372562-6932-4a29-92be-47d4ef65a8a1 tempest-GroupSnapshotsV319Test-2102769450 None] Group tempest-GroupSnapshotsV319Test-Group-1560450909: created successfully Nov 06 21:21:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b5372562-6932-4a29-92be-47d4ef65a8a1 tempest-GroupSnapshotsV319Test-2102769450 None] Create group completed successfully. Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Acquiring lock "cinder-742e51da-01c1-4b8b-9c03-72dc2ed26439-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Lock "cinder-742e51da-01c1-4b8b-9c03-72dc2ed26439-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Acquiring lock "cinder-quobyte-742e51da-01c1-4b8b-9c03-72dc2ed26439" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Lock "cinder-quobyte-742e51da-01c1-4b8b-9c03-72dc2ed26439" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc571381-5185-45b1-85f7-56a0a7ef9fd9]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:28 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 Nov 06 21:21:28 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:28 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439" returned: 0 in 0.341s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:28 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439 Nov 06 21:21:28 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:29 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-742e51da-01c1-4b8b-9c03-72dc2ed26439" returned: 0 in 0.245s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Lock "cinder-quobyte-742e51da-01c1-4b8b-9c03-72dc2ed26439" released by "delete_volume" :: held 0.627s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Created reservations ['f4efd677-23b0-4383-9a00-25eb392f0101', '819fea56-8e55-4fe5-9fda-ccf7cd3f4d3a', 'da2a88e7-4afa-407f-a6d8-82835343226d', 'd3f6c5a1-01e4-46eb-a5b1-b81a42052c62'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:29 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:29 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:29 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.262s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Deleted volume successfully. Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1c4ac61f-abfc-48a7-b3f2-d0ff0c54ef2c tempest-AbsoluteLimitsTests-512017770 None] Lock "cinder-742e51da-01c1-4b8b-9c03-72dc2ed26439-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Flow 'volume_create_manager' (f06ee7d0-9b82-457e-a8fe-75433962a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c34266-2cfb-4410-b173-60b3ac75714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c34266-2cfb-4410-b173-60b3ac75714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806997267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef0e2338-1241-44f5-b4ba-e7e6eaafce0f,host='devstack@QuobyteHD#QuobyteHD',id=02dee8ed-73f8-4774-a63a-27007f189703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34de1d3d37746379ddf484033b9872e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:30Z,use_quota=True,user_id='dc507cfd187640d6953999f6c19a404e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c10727d6-4f92-4270-93c7-bd7f3eac35d1),volume_type_id=c10727d6-4f92-4270-93c7-bd7f3eac35d1)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3935ce7b-3e2f-4f2a-b695-1b5a683cdbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3935ce7b-3e2f-4f2a-b695-1b5a683cdbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b797925f-6a38-40e3-b0f2-ac6e0273eb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b797925f-6a38-40e3-b0f2-ac6e0273eb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dee8ed-73f8-4774-a63a-27007f189703', 'volume_name': 'volume-02dee8ed-73f8-4774-a63a-27007f189703', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a624180c-f73f-4d1d-986a-35a564edbcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a624180c-f73f-4d1d-986a-35a564edbcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd1d5fa-da6a-455f-8add-f09c2ab87e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Volume 02dee8ed-73f8-4774-a63a-27007f189703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dee8ed-73f8-4774-a63a-27007f189703', 'volume_size': 1} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef0e2338-1241-44f5-b4ba-e7e6eaafce0f,created_at=2026-11-06T20:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806997267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef0e2338-1241-44f5-b4ba-e7e6eaafce0f,host='devstack@QuobyteHD#QuobyteHD',id=02dee8ed-73f8-4774-a63a-27007f189703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34de1d3d37746379ddf484033b9872e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:30Z,use_quota=True,user_id='dc507cfd187640d6953999f6c19a404e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c10727d6-4f92-4270-93c7-bd7f3eac35d1),volume_type_id=c10727d6-4f92-4270-93c7-bd7f3eac35d1)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Creating volume 02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:30 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 1073741824 Nov 06 21:21:30 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 1073741824" returned: 0 in 0.480s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:30 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 Nov 06 21:21:30 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:30 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703" returned: 0 in 0.285s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd1d5fa-da6a-455f-8add-f09c2ab87e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dee8ed-73f8-4774-a63a-27007f189703', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1feb156-b5c0-4033-80f2-deefb6f10732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Volume volume-02dee8ed-73f8-4774-a63a-27007f189703 (02dee8ed-73f8-4774-a63a-27007f189703): created successfully Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1feb156-b5c0-4033-80f2-deefb6f10732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Flow 'volume_create_manager' (f06ee7d0-9b82-457e-a8fe-75433962a639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-851b1147-facd-4a65-a276-43e9fd37aa24 tempest-GroupSnapshotsV319Test-2102769450 None] Created volume successfully. Nov 06 21:21:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] GroupSnapshot 0d0efbba-119f-4275-b544-f7f3a9ddd4f1: creating. Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Group snapshot 0d0efbba-119f-4275-b544-f7f3a9ddd4f1: creating. {{(pid=87350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4248}} Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Creating offline snapshot a765ddcb-3e69-44f0-9277-9006db434ddc of volume 02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb875b-a7dc-4dc3-b365-15b6d22827cb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:31 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 Nov 06 21:21:31 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:31 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703" returned: 0 in 0.442s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc 1G Nov 06 21:21:32 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:32 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:32 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 28 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:21:32 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc 1G" returned: 0 in 0.613s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02dee8ed-73f8-4774-a63a-27007f189703 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02dee8ed-73f8-4774-a63a-27007f189703 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc Nov 06 21:21:32 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:32 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02dee8ed-73f8-4774-a63a-27007f189703 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc" returned: 0 in 0.323s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:32 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:32 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc Nov 06 21:21:32 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc" returned: 0 in 0.288s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=131,cinder:UPDATE=154,cinder:INSERT=36,cinder:DELETE=14 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=133,cinder:INSERT=38,cinder:UPDATE=143,cinder:DELETE=10 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info Nov 06 21:21:33 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info" returned: 0 in 0.346s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:33 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info Nov 06 21:21:33 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:33 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.info" returned: 0 in 0.274s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5f2d6770-1f4e-4416-a08c-02120b8a0db2 tempest-GroupSnapshotsV319Test-2102769450 None] group_snapshot 0d0efbba-119f-4275-b544-f7f3a9ddd4f1: created successfully Nov 06 21:21:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] group_snapshot 0d0efbba-119f-4275-b544-f7f3a9ddd4f1: deleting Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] group_snapshot 0d0efbba-119f-4275-b544-f7f3a9ddd4f1: deleting {{(pid=87350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4423}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "cinder-quobyte-02dee8ed-73f8-4774-a63a-27007f189703" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "cinder-quobyte-02dee8ed-73f8-4774-a63a-27007f189703" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "cinder-quobyte-a765ddcb-3e69-44f0-9277-9006db434ddc" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "cinder-quobyte-a765ddcb-3e69-44f0-9277-9006db434ddc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Deleting offline snapshot a765ddcb-3e69-44f0-9277-9006db434ddc of volume 02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] snapshot_file for this snap is: volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d17e56-e394-4ae6-a2ef-09fe89532aa3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:36 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc Nov 06 21:21:36 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Flow 'volume_create_manager' (b465f89b-4827-4de4-9b44-214d3de00be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca1aedb-5f56-47fe-a857-936ab51d4be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca1aedb-5f56-47fe-a857-936ab51d4be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-422026492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabce24e-7c82-4b9f-8792-412f35011c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5f1a2efcd94358a94eeef56d9831e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:36Z,use_quota=True,user_id='73328be2a7394c5fa17a46a087cbde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a87dfea-f7cd-4f80-a2e7-97b1205a3837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a87dfea-f7cd-4f80-a2e7-97b1205a3837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee602e01-af17-4c19-9311-4e2ffe619952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee602e01-af17-4c19-9311-4e2ffe619952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabce24e-7c82-4b9f-8792-412f35011c2d', 'volume_name': 'volume-aabce24e-7c82-4b9f-8792-412f35011c2d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:36 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b08884-6aa7-45d3-87dc-2257ebd6217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b08884-6aa7-45d3-87dc-2257ebd6217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42a5ca5-ecea-4439-be1e-6e0c25626efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:36 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Volume aabce24e-7c82-4b9f-8792-412f35011c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabce24e-7c82-4b9f-8792-412f35011c2d', 'volume_size': 1} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-422026492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabce24e-7c82-4b9f-8792-412f35011c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5f1a2efcd94358a94eeef56d9831e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:36Z,use_quota=True,user_id='73328be2a7394c5fa17a46a087cbde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Creating volume aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:36 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc" returned: 0 in 0.549s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02dee8ed-73f8-4774-a63a-27007f189703(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:36 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d 1073741824 Nov 06 21:21:36 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc0b99-a081-4dcd-8940-76c47ff309ad]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:36 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 Nov 06 21:21:36 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703" returned: 0 in 0.436s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:36 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc Nov 06 21:21:36 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:36 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d 1073741824" returned: 0 in 0.568s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:37 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d Nov 06 21:21:37 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:37 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d" returned: 0 in 0.299s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42a5ca5-ecea-4439-be1e-6e0c25626efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabce24e-7c82-4b9f-8792-412f35011c2d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:37 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505d49d4-86ee-4f9a-9705-4c2d3b02b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc" returned: 0 in 0.451s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Volume volume-aabce24e-7c82-4b9f-8792-412f35011c2d (aabce24e-7c82-4b9f-8792-412f35011c2d): created successfully Nov 06 21:21:37 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc Nov 06 21:21:37 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505d49d4-86ee-4f9a-9705-4c2d3b02b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Flow 'volume_create_manager' (b465f89b-4827-4de4-9b44-214d3de00be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9b641980-7d58-4ce3-89a2-f13fbecc3bcc tempest-VolumesDeleteCascade-1865144553 None] Created volume successfully. Nov 06 21:21:37 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703.a765ddcb-3e69-44f0-9277-9006db434ddc" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "cinder-quobyte-a765ddcb-3e69-44f0-9277-9006db434ddc" released by "_delete_snapshot" :: held 1.904s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Lock "cinder-quobyte-02dee8ed-73f8-4774-a63a-27007f189703" released by "delete_snapshot" :: held 1.939s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:37 devstack cinder-volume[87350]: WARNING cinder.quota [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813904261 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813904261, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:37 devstack cinder-volume[87350]: WARNING cinder.quota [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-813904261 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-813904261, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:37 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] Created reservations ['dc6efc17-1b92-4222-834c-f03ee946be1e', '370a5839-f992-4de3-ad24-8da623690006', '9b6f13af-8807-4050-a671-ccd3265c4300', 'a7b813e3-2614-4714-8685-cd8cf3c68c56'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5def0bfe-caef-4936-82e4-6a91d85fb0e2 tempest-GroupSnapshotsV319Test-2102769450 None] group_snapshot 0d0efbba-119f-4275-b544-f7f3a9ddd4f1: deleted successfully Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Flow 'volume_create_manager' (0cb3d534-abbf-4e66-a714-56da161fe499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaddcb2-f616-4cba-b227-b9e33a07ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beaddcb2-f616-4cba-b227-b9e33a07ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-184373816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f0ebd9-21af-4687-87ff-bb6c4f33479b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06ce1b310964287a136791add3b313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:38Z,use_quota=True,user_id='ed5ebf59e14649b9a3b6b5a181fe40c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a0c288-8ebf-4c05-aa53-9062bc07f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a0c288-8ebf-4c05-aa53-9062bc07f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dab894-327d-4ef2-93e0-268ad4329bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dab894-327d-4ef2-93e0-268ad4329bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f0ebd9-21af-4687-87ff-bb6c4f33479b', 'volume_name': 'volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe47b6d-bdbc-4067-8f42-6d3e114ed625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe47b6d-bdbc-4067-8f42-6d3e114ed625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abef2833-37de-4024-a1e2-6b5dd5cbce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Volume a2f0ebd9-21af-4687-87ff-bb6c4f33479b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b', 'volume_size': 1} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-184373816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f0ebd9-21af-4687-87ff-bb6c4f33479b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06ce1b310964287a136791add3b313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:38Z,use_quota=True,user_id='ed5ebf59e14649b9a3b6b5a181fe40c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Creating volume a2f0ebd9-21af-4687-87ff-bb6c4f33479b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:38 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b 1073741824 Nov 06 21:21:38 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "cinder-quobyte-02dee8ed-73f8-4774-a63a-27007f189703" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Lock "cinder-quobyte-02dee8ed-73f8-4774-a63a-27007f189703" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8c753-8012-4191-9d94-1bf381fd8626]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:38 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 Nov 06 21:21:38 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:39 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703" returned: 0 in 0.415s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:39 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b 1073741824" returned: 0 in 0.559s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:39 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703 Nov 06 21:21:39 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:39 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b Nov 06 21:21:39 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:39 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-02dee8ed-73f8-4774-a63a-27007f189703" returned: 0 in 0.293s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Lock "cinder-quobyte-02dee8ed-73f8-4774-a63a-27007f189703" released by "delete_volume" :: held 0.809s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:39 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b" returned: 0 in 0.283s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.602s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abef2833-37de-4024-a1e2-6b5dd5cbce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cc1de3-bdc7-4fbe-b6f2-28fa1c9ccb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Volume volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b (a2f0ebd9-21af-4687-87ff-bb6c4f33479b): created successfully Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cc1de3-bdc7-4fbe-b6f2-28fa1c9ccb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Flow 'volume_create_manager' (0cb3d534-abbf-4e66-a714-56da161fe499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Creating offline snapshot 947325a2-788e-45da-8c85-273601b2de33 of volume aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-24b73a27-6d4d-4dff-9ac3-46b82c997093 tempest-AttachVolumeNegativeTest-1471779740 None] Created volume successfully. Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b443367-9d32-48be-8688-c67b11f16756]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Created reservations ['6364a00f-3bbf-4dfe-819e-a81cf737379e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:39 devstack cinder-volume[87350]: WARNING cinder.quota [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-813904261 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-813904261, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Created reservations ['cc8f48de-0753-4d07-9bf4-df7fca46a4fc', '02fb9f7e-61f3-413d-940e-b6cee4ca87e0', '0e0b577d-cca5-46e0-9038-4ec6a20ac83a', '6e078985-d93f-4083-8391-1b21e12269fc'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:39 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d Nov 06 21:21:39 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:39 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:39 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:40 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:40 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d" returned: 0 in 0.553s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-62ff0e8c-5bd6-459e-9c9f-5c43b324038c tempest-GroupSnapshotsV319Test-2102769450 None] Delete group completed successfully. Nov 06 21:21:40 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 1G Nov 06 21:21:40 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:40 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 1G" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabce24e-7c82-4b9f-8792-412f35011c2d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:40 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabce24e-7c82-4b9f-8792-412f35011c2d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:40 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:40 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabce24e-7c82-4b9f-8792-412f35011c2d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.373s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:40 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 is being set with open permissions: ugo+rw Nov 06 21:21:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:40 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:40 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:41 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-b95b197e-2dcd-45d3-b21d-9b9c1071ed39 req-2cace7e5-6ffa-436b-8ab4-d8754fdd12ba tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:41 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info Nov 06 21:21:41 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:41 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info" returned: 0 in 0.296s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:41 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info is being set with open permissions: ugo+rw Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:41 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info Nov 06 21:21:41 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:41 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.info" returned: 0 in 0.254s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-b95b197e-2dcd-45d3-b21d-9b9c1071ed39 req-2cace7e5-6ffa-436b-8ab4-d8754fdd12ba tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.607s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-b95b197e-2dcd-45d3-b21d-9b9c1071ed39 req-2cace7e5-6ffa-436b-8ab4-d8754fdd12ba tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cb54de79-7bac-4425-a560-be1bad32b48c tempest-VolumesDeleteCascade-1865144553 None] Create snapshot completed successfully Nov 06 21:21:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-b95b197e-2dcd-45d3-b21d-9b9c1071ed39 req-2cace7e5-6ffa-436b-8ab4-d8754fdd12ba tempest-AttachVolumeNegativeTest-1471779740 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8acf4b80-0b76-4fde-bac7-3fa3eff6786d', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:21:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-b95b197e-2dcd-45d3-b21d-9b9c1071ed39 req-2cace7e5-6ffa-436b-8ab4-d8754fdd12ba tempest-AttachVolumeNegativeTest-1471779740 None] attachment_update completed successfully. Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Creating offline snapshot 4649522b-a027-4228-8242-a98b3328850e of volume aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1888c-7849-457a-9ecd-ff0ea03a0ad1]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:42 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:42 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:42 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.519s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aabce24e-7c82-4b9f-8792-412f35011c2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:42 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e 1G Nov 06 21:21:42 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:43 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e 1G" returned: 0 in 0.586s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:43 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e Nov 06 21:21:43 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:43 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e" returned: 0 in 0.329s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:43 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e is being set with open permissions: ugo+rw Nov 06 21:21:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:43 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e Nov 06 21:21:43 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:44 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e" returned: 0 in 0.303s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-13e01113-d120-4587-80b5-6dc52a2e262d tempest-VolumesDeleteCascade-1865144553 None] Create snapshot completed successfully Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-aabce24e-7c82-4b9f-8792-412f35011c2d-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-aabce24e-7c82-4b9f-8792-412f35011c2d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Performing cascade delete. {{(pid=87350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1007}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-4649522b-a027-4228-8242-a98b3328850e-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-4649522b-a027-4228-8242-a98b3328850e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-4649522b-a027-4228-8242-a98b3328850e" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-4649522b-a027-4228-8242-a98b3328850e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Deleting offline snapshot 4649522b-a027-4228-8242-a98b3328850e of volume aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] snapshot_file for this snap is: volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8bc5a0-d46d-4fe7-8a04-b23b3ee59bf6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:44 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e Nov 06 21:21:44 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e" returned: 0 in 0.497s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aabce24e-7c82-4b9f-8792-412f35011c2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0edaccd-5b3e-4dfc-bc7b-b09746c93cbe]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:45 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:45 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.564s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aabce24e-7c82-4b9f-8792-412f35011c2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:45 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e Nov 06 21:21:45 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e" returned: 0 in 0.457s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:46 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e Nov 06 21:21:46 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:46 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.4649522b-a027-4228-8242-a98b3328850e" returned: 0 in 0.313s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-4649522b-a027-4228-8242-a98b3328850e" released by "_delete_snapshot" :: held 1.983s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" released by "delete_snapshot" :: held 2.018s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Created reservations ['a1eedbce-a66a-4dbc-aa02-c4b3f20c6cd8', '55d044b1-560c-49cc-a99f-602864f3c111', '419f407d-c396-43f7-9798-76925e90fdab', '99d8a7ae-7ed6-4b93-8a86-97805baad643'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Delete snapshot completed successfully. Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-4649522b-a027-4228-8242-a98b3328850e-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-947325a2-788e-45da-8c85-273601b2de33-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-947325a2-788e-45da-8c85-273601b2de33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-947325a2-788e-45da-8c85-273601b2de33" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-947325a2-788e-45da-8c85-273601b2de33" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Deleting offline snapshot 947325a2-788e-45da-8c85-273601b2de33 of volume aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] snapshot_file for this snap is: volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e6920-fb54-41e1-b2f2-9d0b3dadeb34]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:47 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.444s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aabce24e-7c82-4b9f-8792-412f35011c2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:21:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c813bc-adda-4f8e-868f-282690a9638b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d Nov 06 21:21:47 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:47 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d" returned: 0 in 0.482s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:47 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:47 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:48 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.443s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:48 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33 Nov 06 21:21:48 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:48 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d.947325a2-788e-45da-8c85-273601b2de33" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-947325a2-788e-45da-8c85-273601b2de33" released by "_delete_snapshot" :: held 1.863s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-70fa82ea-d2e3-4053-a409-50f4b3cafe78 tempest-GroupsV314Test-1509561562 None] Group tempest-GroupsV314Test-Group-760173902: creating Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" released by "delete_snapshot" :: held 1.898s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-70fa82ea-d2e3-4053-a409-50f4b3cafe78 tempest-GroupsV314Test-1509561562 None] Group tempest-GroupsV314Test-Group-760173902: created successfully Nov 06 21:21:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-70fa82ea-d2e3-4053-a409-50f4b3cafe78 tempest-GroupsV314Test-1509561562 None] Create group completed successfully. Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Created reservations ['04a573fa-1e5d-4998-85a6-9f8a11b56164', '42809997-4e36-43a4-8b3a-616c1cf73c1e', '0761387d-52b5-4cb1-b654-8afd2c91d17d', '13675647-ed2e-418d-acbc-f9d470c499b0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Delete snapshot completed successfully. Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-947325a2-788e-45da-8c85-273601b2de33-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Snapshots deleted, issuing volume delete {{(pid=87350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1022}} Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62d60f7-7cfa-4d95-83d1-ea8ff0d50d1c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:49 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d Nov 06 21:21:49 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Flow 'volume_create_manager' (3a859e06-445f-415d-a7f2-240954488ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1e15ec-8ed3-438b-9432-c03360ece9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1e15ec-8ed3-438b-9432-c03360ece9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-60373085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f1e62c-4410-41a6-b976-4e38beb47210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3cc113553c4013a66236cfbab2e32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:49Z,use_quota=True,user_id='cd3abbbf5b594be19840cf37be59f8cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ecbff45-bc0f-4a3c-9575-6042579e2e7f),volume_type_id=2ecbff45-bc0f-4a3c-9575-6042579e2e7f)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a14ced-6cf5-47ce-8bd8-cd9b1eae1661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a14ced-6cf5-47ce-8bd8-cd9b1eae1661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf86eeb8-b14d-4b60-b40e-62eff2682274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf86eeb8-b14d-4b60-b40e-62eff2682274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f1e62c-4410-41a6-b976-4e38beb47210', 'volume_name': 'volume-a4f1e62c-4410-41a6-b976-4e38beb47210', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a7435d-9052-4a8a-88d2-ead99cf8f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a7435d-9052-4a8a-88d2-ead99cf8f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58257871-8455-4c7d-87ab-eacb70b63a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Volume a4f1e62c-4410-41a6-b976-4e38beb47210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f1e62c-4410-41a6-b976-4e38beb47210', 'volume_size': 1} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-60373085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f1e62c-4410-41a6-b976-4e38beb47210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3cc113553c4013a66236cfbab2e32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:49Z,use_quota=True,user_id='cd3abbbf5b594be19840cf37be59f8cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ecbff45-bc0f-4a3c-9575-6042579e2e7f),volume_type_id=2ecbff45-bc0f-4a3c-9575-6042579e2e7f)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Creating volume a4f1e62c-4410-41a6-b976-4e38beb47210 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:49 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:49 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 1073741824 Nov 06 21:21:49 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:49 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d" returned: 0 in 0.441s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:49 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d Nov 06 21:21:49 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:49 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aabce24e-7c82-4b9f-8792-412f35011c2d" returned: 0 in 0.282s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-aabce24e-7c82-4b9f-8792-412f35011c2d" released by "delete_volume" :: held 0.816s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Created reservations ['f8006dfa-8caa-4cd7-b593-9192cf11e688', 'd82ebe48-2299-4d8d-96a1-544ec0b75a01', '4814a4c2-f90c-4be6-9b7f-3e30b12821c6', '3a093301-3d7a-4ecf-a17e-73285d2e1026'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:49 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 1073741824" returned: 0 in 0.614s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:50 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 Nov 06 21:21:50 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:50 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:50 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:50 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210" returned: 0 in 0.493s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58257871-8455-4c7d-87ab-eacb70b63a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f1e62c-4410-41a6-b976-4e38beb47210', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58c55e4-f23a-4174-b4d6-9856833e3780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Volume volume-a4f1e62c-4410-41a6-b976-4e38beb47210 (a4f1e62c-4410-41a6-b976-4e38beb47210): created successfully Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58c55e4-f23a-4174-b4d6-9856833e3780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Flow 'volume_create_manager' (3a859e06-445f-415d-a7f2-240954488ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:50 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.655s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Deleted volume successfully. Nov 06 21:21:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-581b5e8d-dbff-4201-b382-7b2607ef9c70 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Created volume successfully. Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1d0cfa40-c45e-45b3-93d9-e930d9a9eb9a tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-aabce24e-7c82-4b9f-8792-412f35011c2d-delete_volume" released by "delete_volume" :: held 6.369s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Flow 'volume_create_manager' (01cc353f-1553-448b-97c5-f542b77db3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0bc862-6c6d-4021-be82-f5cd5710a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0bc862-6c6d-4021-be82-f5cd5710a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117275487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=545763e6-4b52-428f-aaa7-cc189d233d75,host='devstack@QuobyteHD#QuobyteHD',id=d0fae857-93e5-4987-9182-ac3afcdb07b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c87aecc284aa41e6bbe2a598167bad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:51Z,use_quota=True,user_id='7ca6c301503f47f1823ab4bfd230b1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fd0fe7f-a651-4f2e-80fc-3b5708bbd931),volume_type_id=5fd0fe7f-a651-4f2e-80fc-3b5708bbd931)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e476e00-cc7e-4666-b87a-99ec02d52d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e476e00-cc7e-4666-b87a-99ec02d52d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaae528d-bd34-430f-8f52-d9a6688a2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaae528d-bd34-430f-8f52-d9a6688a2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0fae857-93e5-4987-9182-ac3afcdb07b0', 'volume_name': 'volume-d0fae857-93e5-4987-9182-ac3afcdb07b0', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7141e0-7d7b-4a4f-97c7-14a6bd25af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7141e0-7d7b-4a4f-97c7-14a6bd25af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57dfff2-cfb8-4308-a803-e3eca8e2bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Volume d0fae857-93e5-4987-9182-ac3afcdb07b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0fae857-93e5-4987-9182-ac3afcdb07b0', 'volume_size': 1} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=545763e6-4b52-428f-aaa7-cc189d233d75,created_at=2026-11-06T20:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117275487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=545763e6-4b52-428f-aaa7-cc189d233d75,host='devstack@QuobyteHD#QuobyteHD',id=d0fae857-93e5-4987-9182-ac3afcdb07b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c87aecc284aa41e6bbe2a598167bad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:51Z,use_quota=True,user_id='7ca6c301503f47f1823ab4bfd230b1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fd0fe7f-a651-4f2e-80fc-3b5708bbd931),volume_type_id=5fd0fe7f-a651-4f2e-80fc-3b5708bbd931)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Creating volume d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:50 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:51 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 1073741824 Nov 06 21:21:51 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Flow 'volume_create_manager' (815de25a-1d1c-46cd-b908-775c679def4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31da3da9-ab23-4dfc-8a3b-08fb6434e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31da3da9-ab23-4dfc-8a3b-08fb6434e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1802663077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5f1a2efcd94358a94eeef56d9831e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:51Z,use_quota=True,user_id='73328be2a7394c5fa17a46a087cbde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20afe0d-e62f-47a7-bb99-3b490d024aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20afe0d-e62f-47a7-bb99-3b490d024aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58ffbb-3913-40f7-ba55-bc04605e4698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58ffbb-3913-40f7-ba55-bc04605e4698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7', 'volume_name': 'volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc1b568-9be6-4788-9404-dd8b6ebfff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc1b568-9be6-4788-9404-dd8b6ebfff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56131b0b-0e31-44c8-9799-bca95574597a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:51 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Volume cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7', 'volume_size': 1} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:51 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 1073741824" returned: 0 in 0.729s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:51 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 Nov 06 21:21:51 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:52 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0" returned: 0 in 0.330s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1802663077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5f1a2efcd94358a94eeef56d9831e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:51Z,use_quota=True,user_id='73328be2a7394c5fa17a46a087cbde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Creating volume cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:21:52 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57dfff2-cfb8-4308-a803-e3eca8e2bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0fae857-93e5-4987-9182-ac3afcdb07b0', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd217c1-5a09-4bcc-85cc-9c63d2387f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:52 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 1073741824 Nov 06 21:21:52 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Volume volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 (d0fae857-93e5-4987-9182-ac3afcdb07b0): created successfully Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd217c1-5a09-4bcc-85cc-9c63d2387f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Flow 'volume_create_manager' (01cc353f-1553-448b-97c5-f542b77db3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-91818278-8db6-42cd-a12f-ec009f1477d3 tempest-GroupsV314Test-1509561562 None] Created volume successfully. Nov 06 21:21:52 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:52 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:52 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.310s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-28a89307-0395-4b1b-acff-60c16020aee9 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Retype volume completed successfully. Nov 06 21:21:52 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 1073741824" returned: 0 in 0.570s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:52 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 Nov 06 21:21:52 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:52 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" returned: 0 in 0.249s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56131b0b-0e31-44c8-9799-bca95574597a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bb5149-1e0d-498d-8be9-0cee098bb472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Volume volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 (cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7): created successfully Nov 06 21:21:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bb5149-1e0d-498d-8be9-0cee098bb472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Flow 'volume_create_manager' (815de25a-1d1c-46cd-b908-775c679def4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:53 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-08356696-5ee7-4c1f-a0fa-3ef7a0f35aa4 tempest-VolumesDeleteCascade-1865144553 None] Created volume successfully. Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Acquiring lock "cinder-a4f1e62c-4410-41a6-b976-4e38beb47210-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "cinder-a4f1e62c-4410-41a6-b976-4e38beb47210-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Acquiring lock "cinder-quobyte-a4f1e62c-4410-41a6-b976-4e38beb47210" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "cinder-quobyte-a4f1e62c-4410-41a6-b976-4e38beb47210" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c21f3e-09b0-493e-a138-f31579bcd429]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:54 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 Nov 06 21:21:54 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Creating offline snapshot 20fee486-b62d-44b1-a392-2fdf62ce4e61 of volume cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1778c7d-8f5b-4d5d-95df-97a84e8db600]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:54 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210" returned: 0 in 0.687s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:54 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210 Nov 06 21:21:54 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:54 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 Nov 06 21:21:54 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" returned: 0 in 0.582s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 1G Nov 06 21:21:55 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4f1e62c-4410-41a6-b976-4e38beb47210" returned: 0 in 0.515s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "cinder-quobyte-a4f1e62c-4410-41a6-b976-4e38beb47210" released by "delete_volume" :: held 1.326s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:55 devstack cinder-volume[87350]: WARNING cinder.quota [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:55 devstack cinder-volume[87350]: WARNING cinder.quota [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Created reservations ['a683b3e4-6dae-46cf-b76d-1f51ee73df1d', 'c0b5da87-3e53-4bb2-bdff-42cb6080451d', '572a7496-bf44-4537-bd54-f77a9e8ed49e', 'fe36344f-67d0-472c-bfae-9addf2f777c4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:21:55 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:21:55 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 1G" returned: 0 in 0.651s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Deleted volume successfully. Nov 06 21:21:55 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 Nov 06 21:21:55 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3b28d808-87fa-4ef4-a126-c17858aa8938 tempest-VolumeRetypeWithoutMigrationTest-1885681832 None] Lock "cinder-a4f1e62c-4410-41a6-b976-4e38beb47210-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:21:55 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61" returned: 0 in 0.322s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:55 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 is being set with open permissions: ugo+rw Nov 06 21:21:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:56 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 Nov 06 21:21:56 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:56 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61" returned: 0 in 0.294s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:56 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info Nov 06 21:21:56 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:56 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info" returned: 0 in 0.298s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:56 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info is being set with open permissions: ugo+rw Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:56 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info Nov 06 21:21:56 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:56 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.info" returned: 0 in 0.283s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:21:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.542s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:21:56 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Cloning volume d0fae857-93e5-4987-9182-ac3afcdb07b0 to volume b99fd838-32c1-4747-b9e9-4714f88b6efa Nov 06 21:21:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-96d1bf3f-68a0-4180-b05a-3295028f0b12 tempest-VolumesDeleteCascade-1865144553 None] Create snapshot completed successfully Nov 06 21:21:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Creating offline snapshot 0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c of volume d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:21:57 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b862b04a-a8ae-4270-b61a-56e51cbf0d9d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:21:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:57 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 Nov 06 21:21:57 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:57 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0" returned: 0 in 0.677s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:57 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c 1G Nov 06 21:21:57 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:21:58 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c 1G" returned: 0 in 0.750s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:58 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c Nov 06 21:21:58 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Flow 'volume_create_manager' (ac04f815-8637-401a-95a4-cbbb0663f78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e28761-4186-4aec-9682-f8a347599d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e28761-4186-4aec-9682-f8a347599d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-920048944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48398bb8-f6b3-43c8-a325-f56d00d31562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5f1a2efcd94358a94eeef56d9831e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20fee486-b62d-44b1-a392-2fdf62ce4e61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:21:58Z,use_quota=True,user_id='73328be2a7394c5fa17a46a087cbde89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1086c0-a18c-4f5c-ba49-f69fc0ecf538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1086c0-a18c-4f5c-ba49-f69fc0ecf538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb20a65-d25f-477f-9d4c-2445d4ea7d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb20a65-d25f-477f-9d4c-2445d4ea7d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48398bb8-f6b3-43c8-a325-f56d00d31562', 'volume_name': 'volume-48398bb8-f6b3-43c8-a325-f56d00d31562', 'volume_size': 1, 'snapshot_id': '20fee486-b62d-44b1-a392-2fdf62ce4e61'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae1c2e3-0f21-436b-bcd7-c156010d3eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae1c2e3-0f21-436b-bcd7-c156010d3eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e140b1-9b18-4b7b-8410-288a2a02f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:21:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Volume 48398bb8-f6b3-43c8-a325-f56d00d31562: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48398bb8-f6b3-43c8-a325-f56d00d31562', 'volume_size': 1, 'snapshot_id': '20fee486-b62d-44b1-a392-2fdf62ce4e61'} Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:21:58 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" returned: 0 in 0.417s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:58 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:58 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c Nov 06 21:21:58 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:59 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" returned: 0 in 0.449s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:59 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info Nov 06 21:21:59 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:21:59 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 06 21:21:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info" returned: 0 in 0.360s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:21:59 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:21:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:21:59 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info Nov 06 21:21:59 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:00 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.info" returned: 0 in 0.373s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Acquiring lock "cinder-quobyte-b99fd838-32c1-4747-b9e9-4714f88b6efa" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-b99fd838-32c1-4747-b9e9-4714f88b6efa" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] snapshot: 0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c, volume: b99fd838-32c1-4747-b9e9-4714f88b6efa, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e1f5c1-868f-4a7f-8e90-4f0e625d2ef4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:00 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c Nov 06 21:22:00 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:00 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" returned: 0 in 0.423s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0fae857-93e5-4987-9182-ac3afcdb07b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f99e0b5-af2b-45d0-bf27-4dbe03fbe8db]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:00 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 Nov 06 21:22:00 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:01 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:22:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:22:01 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:22:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:01 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa Nov 06 21:22:01 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:08 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa" returned: 0 in 7.535s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:08 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Converted 1024.00 MB image at 135.88 MB/s Nov 06 21:22:08 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:08 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa Nov 06 21:22:08 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:08 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa" returned: 0 in 0.251s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-b99fd838-32c1-4747-b9e9-4714f88b6efa" released by "_copy_volume_from_snapshot" :: held 8.724s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Acquiring lock "cinder-quobyte-0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Deleting offline snapshot 0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c of volume d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] snapshot_file for this snap is: volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0d8a23-98ae-4e27-9f21-a444fd4fe19c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:09 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c Nov 06 21:22:09 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=79,cinder:INSERT=12,cinder:UPDATE=68,cinder:DELETE=6 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:09 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" returned: 0 in 0.516s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0fae857-93e5-4987-9182-ac3afcdb07b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d80435-19e5-43cb-9a1c-8510359c2b2d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:09 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 Nov 06 21:22:09 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:10 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0" returned: 0 in 0.557s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:10 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c Nov 06 21:22:10 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:10 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" returned: 0 in 0.390s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:10 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c Nov 06 21:22:10 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:10 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0.0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" returned: 0 in 0.284s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-0e2b8bdd-b2cd-4394-ad09-5e44fd00f16c" released by "_delete_snapshot" :: held 1.888s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.945s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.116s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-20fee486-b62d-44b1-a392-2fdf62ce4e61-48398bb8-f6b3-43c8-a325-f56d00d31562" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-20fee486-b62d-44b1-a392-2fdf62ce4e61-48398bb8-f6b3-43c8-a325-f56d00d31562" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Creating volume 48398bb8-f6b3-43c8-a325-f56d00d31562 from snapshot 20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-48398bb8-f6b3-43c8-a325-f56d00d31562" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-48398bb8-f6b3-43c8-a325-f56d00d31562" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] snapshot: 20fee486-b62d-44b1-a392-2fdf62ce4e61, volume: 48398bb8-f6b3-43c8-a325-f56d00d31562, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e6598-27da-4c44-b114-ec1a7f07cc49]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5daafeac-4e4f-46af-9eb3-5027dcfec341 tempest-GroupsV314Test-1509561562 None] Create group from source-group-545763e6-4b52-428f-aaa7-cc189d233d75 completed successfully. Nov 06 21:22:11 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 Nov 06 21:22:11 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:11 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61" returned: 0 in 0.403s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[166457fc-2af4-4d3a-a73d-0ee3cd9448e3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:11 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 Nov 06 21:22:11 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:11 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" returned: 0 in 0.411s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:22:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:11 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 Nov 06 21:22:11 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Acquiring lock "cinder-quobyte-b99fd838-32c1-4747-b9e9-4714f88b6efa" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-b99fd838-32c1-4747-b9e9-4714f88b6efa" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf06383-e547-4a25-a724-1023f6ba0eea]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:12 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa Nov 06 21:22:12 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:12 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa" returned: 0 in 0.544s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:12 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa Nov 06 21:22:12 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:12 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b99fd838-32c1-4747-b9e9-4714f88b6efa" returned: 0 in 0.348s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-b99fd838-32c1-4747-b9e9-4714f88b6efa" released by "delete_volume" :: held 0.963s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Created reservations ['6a2b8339-43d9-4c40-b2a7-c9809129b413'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:13 devstack cinder-volume[87350]: WARNING cinder.quota [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-412287271 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-412287271, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:13 devstack cinder-volume[87350]: WARNING cinder.quota [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-412287271 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-412287271, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Created reservations ['4c1efe0b-2428-4529-90ef-c721d241b7ce', 'a00d71ab-3c7d-4ac2-b6ad-24e41915e6ca', 'e4a30e68-935a-4759-a21d-2dc80bb01a2c', 'f310fe18-581e-4fbc-ad24-285570332243'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:13 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:13 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:14 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.643s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:14 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4b33f3d3-c544-4714-849e-5f061174a9f3 tempest-GroupsV314Test-1509561562 None] Delete group completed successfully. Nov 06 21:22:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Acquiring lock "cinder-quobyte-d0fae857-93e5-4987-9182-ac3afcdb07b0" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-d0fae857-93e5-4987-9182-ac3afcdb07b0" acquired by "delete_volume" :: waited 0.053s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:15 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8354586c-5007-426d-9763-718b3477c820]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:15 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 Nov 06 21:22:15 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:15 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0" returned: 0 in 0.693s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:15 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0 Nov 06 21:22:15 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:16 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d0fae857-93e5-4987-9182-ac3afcdb07b0" returned: 0 in 0.584s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Lock "cinder-quobyte-d0fae857-93e5-4987-9182-ac3afcdb07b0" released by "delete_volume" :: held 1.461s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Created reservations ['bb120985-23e1-4510-8d49-b669623712d5'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Created reservations ['7fc9d7d3-b92e-4e74-b8cb-35d397a89338', '51f234ad-9ee0-4ce4-9c00-bfc05b2330fc', '7441c08a-c704-425f-8588-2bb2390c113f', '298fb479-33c7-4805-a00c-80a3b82eff67'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:17 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:17 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:17 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.619s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:17 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:17 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-21204b80-da9c-4555-85f3-9c49204c97d9 tempest-GroupsV314Test-1509561562 None] Delete group completed successfully. Nov 06 21:22:20 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562" returned: 0 in 8.445s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:22:20 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Converted 1024.00 MB image at 121.25 MB/s Nov 06 21:22:20 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 is being set with open permissions: ugo+rw Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:20 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 Nov 06 21:22:20 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:20 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562" returned: 0 in 0.248s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-48398bb8-f6b3-43c8-a325-f56d00d31562" released by "_copy_volume_from_snapshot" :: held 9.623s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-20fee486-b62d-44b1-a392-2fdf62ce4e61-48398bb8-f6b3-43c8-a325-f56d00d31562" released by "_create_volume_from_snapshot" :: held 9.702s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.725s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e140b1-9b18-4b7b-8410-288a2a02f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48398bb8-f6b3-43c8-a325-f56d00d31562', 'volume_size': 1, 'snapshot_id': '20fee486-b62d-44b1-a392-2fdf62ce4e61'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3630b580-6042-4f02-93a1-d008c0837dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:20 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Volume volume-48398bb8-f6b3-43c8-a325-f56d00d31562 (48398bb8-f6b3-43c8-a325-f56d00d31562): created successfully Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3630b580-6042-4f02-93a1-d008c0837dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Flow 'volume_create_manager' (ac04f815-8637-401a-95a4-cbbb0663f78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:20 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7d3beb36-ad36-435c-8a61-64447c12ac0e tempest-VolumesDeleteCascade-1865144553 None] Created volume successfully. Nov 06 21:22:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Performing cascade delete. {{(pid=87350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1007}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-20fee486-b62d-44b1-a392-2fdf62ce4e61-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-20fee486-b62d-44b1-a392-2fdf62ce4e61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-20fee486-b62d-44b1-a392-2fdf62ce4e61" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-20fee486-b62d-44b1-a392-2fdf62ce4e61" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Deleting offline snapshot 20fee486-b62d-44b1-a392-2fdf62ce4e61 of volume cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] snapshot_file for this snap is: volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bfd658-9019-4090-8416-ab25dbebe624]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:22 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 Nov 06 21:22:22 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:22 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61" returned: 0 in 0.717s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:22:23 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[084a9683-8695-4927-85bd-8ccc771d1166]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:23 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 Nov 06 21:22:23 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:23 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" returned: 0 in 0.895s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:23 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 Nov 06 21:22:23 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:24 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61" returned: 0 in 0.565s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:24 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61 Nov 06 21:22:24 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:24 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7.20fee486-b62d-44b1-a392-2fdf62ce4e61" returned: 0 in 0.392s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-20fee486-b62d-44b1-a392-2fdf62ce4e61" released by "_delete_snapshot" :: held 2.761s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" released by "delete_snapshot" :: held 2.808s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Created reservations ['a63986d5-2e93-459d-9b52-8e35fa3794a9', 'd3e1ac55-1869-4e30-b9bc-e535ae5a586e', '9f6a6c50-501b-4597-906c-547010997010', 'e54b7065-8caf-423a-aa49-16f94aa27cf1'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Delete snapshot completed successfully. Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-20fee486-b62d-44b1-a392-2fdf62ce4e61-delete_snapshot" released by "delete_snapshot" :: held 3.052s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Snapshots deleted, issuing volume delete {{(pid=87350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1022}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3200dc-eb2f-4c4b-98de-833ef1fc9a3e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 Nov 06 21:22:25 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:25 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" returned: 0 in 0.490s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:25 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7 Nov 06 21:22:25 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7" released by "delete_volume" :: held 0.911s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Created reservations ['d54582da-305f-470e-ab52-984937445689', 'f8996fa2-b620-4bfd-8b7c-1b84daaa2543', '175a12fb-744b-44e2-9527-aa9ce20b33af', '8a2b3d6c-1196-44e3-a973-78bfbc4abdf0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:26 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:26 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-48398bb8-f6b3-43c8-a325-f56d00d31562-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-48398bb8-f6b3-43c8-a325-f56d00d31562-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:26 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.417s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:26 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Deleted volume successfully. Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "cinder-quobyte-48398bb8-f6b3-43c8-a325-f56d00d31562" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8071bb0d-932e-4eaf-a342-82740de0edb6 tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-cdaaf0b6-dd78-4bd8-959c-fdbec31a1fe7-delete_volume" released by "delete_volume" :: held 4.796s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-48398bb8-f6b3-43c8-a325-f56d00d31562" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9adab0c-381d-477c-954f-f65976f73bf4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 Nov 06 21:22:27 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562" returned: 0 in 0.541s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:27 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562 Nov 06 21:22:27 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:27 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-48398bb8-f6b3-43c8-a325-f56d00d31562" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:27 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-quobyte-48398bb8-f6b3-43c8-a325-f56d00d31562" released by "delete_volume" :: held 1.039s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:27 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Created reservations ['8381c46a-924c-4c39-a1a0-26f7bc64fdcb', '91dcce6f-2811-4bec-871c-ee69d663a5c4', '1419722f-51fa-41ba-b536-8bddc4889ba4', '057845c3-731b-4593-82be-4af5b07c87cb'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:28 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-1e586f9d-a868-4ed5-82fd-33ebad7cd5b9 req-10927c7f-d08e-4952-bb7c-f62c6a6e871b tempest-AttachVolumeNegativeTest-1471779740 None] Terminate volume connection completed successfully. Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-1e586f9d-a868-4ed5-82fd-33ebad7cd5b9 req-10927c7f-d08e-4952-bb7c-f62c6a6e871b tempest-AttachVolumeNegativeTest-1471779740 None] Deleting attachment 8acf4b80-0b76-4fde-bac7-3fa3eff6786d. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:28 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Flow 'volume_create_manager' (835bbd16-6afc-4249-95b0-8f8fd2fa1a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab26dee-e50a-44e4-97d4-67c66ffe8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.412s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Deleted volume successfully. Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab26dee-e50a-44e4-97d4-67c66ffe8f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1159678513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4a546f-9543-44e6-b936-5cf6ecc5a906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d56eadbb92d43aaa1029e38550463f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:28Z,use_quota=True,user_id='53c06daa87c444138ed3ec52748dce06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8315ed2-4f47-495f-8412-a68b2c4281c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8315ed2-4f47-495f-8412-a68b2c4281c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d70601-8e6e-4460-8898-fedeea41f318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d70601-8e6e-4460-8898-fedeea41f318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4a546f-9543-44e6-b936-5cf6ecc5a906', 'volume_name': 'volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa6a3ed-e8a5-4b3b-a7fd-ed494e65eda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa6a3ed-e8a5-4b3b-a7fd-ed494e65eda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7ff6d0-baef-418b-95de-6fbfa4f81df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Volume 1b4a546f-9543-44e6-b936-5cf6ecc5a906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906', 'volume_size': 1} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1159678513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4a546f-9543-44e6-b936-5cf6ecc5a906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d56eadbb92d43aaa1029e38550463f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:28Z,use_quota=True,user_id='53c06daa87c444138ed3ec52748dce06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Creating volume 1b4a546f-9543-44e6-b936-5cf6ecc5a906 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:28 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f39ae1e3-b4df-4c5d-8635-9d3959bba32e tempest-VolumesDeleteCascade-1865144553 None] Lock "cinder-48398bb8-f6b3-43c8-a325-f56d00d31562-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:28 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 1073741824 Nov 06 21:22:28 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 1073741824" returned: 0 in 0.541s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:29 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 Nov 06 21:22:29 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:29 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906" returned: 0 in 0.506s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7ff6d0-baef-418b-95de-6fbfa4f81df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ad733-e778-4d69-b323-880929f2cc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Volume volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 (1b4a546f-9543-44e6-b936-5cf6ecc5a906): created successfully Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ad733-e778-4d69-b323-880929f2cc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Flow 'volume_create_manager' (835bbd16-6afc-4249-95b0-8f8fd2fa1a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-add9d96b-6d2c-4acf-aaca-e2333b3558b2 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Created volume successfully. Nov 06 21:22:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Acquiring lock "cinder-1b4a546f-9543-44e6-b936-5cf6ecc5a906-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "cinder-1b4a546f-9543-44e6-b936-5cf6ecc5a906-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Acquiring lock "cinder-quobyte-1b4a546f-9543-44e6-b936-5cf6ecc5a906" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "cinder-quobyte-1b4a546f-9543-44e6-b936-5cf6ecc5a906" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6691b40-8ec7-425a-99ef-3dd6164c3d7f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:32 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 Nov 06 21:22:32 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:32 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:32 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:32 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906" returned: 0 in 0.584s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:32 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.468s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:32 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906 Nov 06 21:22:32 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 28 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:22:32 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1b4a546f-9543-44e6-b936-5cf6ecc5a906" returned: 0 in 0.376s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "cinder-quobyte-1b4a546f-9543-44e6-b936-5cf6ecc5a906" released by "delete_volume" :: held 1.023s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Created reservations ['55a0b15c-a8f8-4dfc-ada4-916f8afd14fb', '91d064c5-b1a8-4a52-ad72-06fb4907c4e9', 'b262db80-6e05-4072-a9de-067beeaba1e4', 'bb6e333a-3dff-41c9-9a52-19a417d3e034'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:33 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:33 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:33 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Deleted volume successfully. Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=132,cinder:UPDATE=142,cinder:INSERT=34,cinder:DELETE=6 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64ed181d-e3ba-40f9-873c-2bdbba66ad74 tempest-VolumeQuotasNegativeTestJSON-996664808 None] Lock "cinder-1b4a546f-9543-44e6-b936-5cf6ecc5a906-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Flow 'volume_create_manager' (39742ad9-7b6f-4347-abd1-c048d127e4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f073a318-6b8b-4875-a916-faae1830964e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f073a318-6b8b-4875-a916-faae1830964e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1827696144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af23ab8a-8d2d-4f63-baef-0794070f9775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c794737de4b42f79a2e6fc491317c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:37Z,use_quota=True,user_id='ef9503159b4845e9ac9444d61e880e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650dc47b-d778-4fa5-b771-4694085cc640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650dc47b-d778-4fa5-b771-4694085cc640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f9e922-acff-469e-99e4-4d2afa9eff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f9e922-acff-469e-99e4-4d2afa9eff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af23ab8a-8d2d-4f63-baef-0794070f9775', 'volume_name': 'volume-af23ab8a-8d2d-4f63-baef-0794070f9775', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adeeaea-414d-4aa6-859a-59f7d31f5eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adeeaea-414d-4aa6-859a-59f7d31f5eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afc4006-877b-40cc-90e8-7781c218d073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Volume af23ab8a-8d2d-4f63-baef-0794070f9775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af23ab8a-8d2d-4f63-baef-0794070f9775', 'volume_size': 1} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1827696144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af23ab8a-8d2d-4f63-baef-0794070f9775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c794737de4b42f79a2e6fc491317c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:37Z,use_quota=True,user_id='ef9503159b4845e9ac9444d61e880e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Creating volume af23ab8a-8d2d-4f63-baef-0794070f9775 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:37 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:37 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 1073741824 Nov 06 21:22:37 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:37 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 1073741824" returned: 0 in 0.587s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:37 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 Nov 06 21:22:37 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:38 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afc4006-877b-40cc-90e8-7781c218d073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af23ab8a-8d2d-4f63-baef-0794070f9775', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91ce8de-2aff-46ab-824d-839cd8d6750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Volume volume-af23ab8a-8d2d-4f63-baef-0794070f9775 (af23ab8a-8d2d-4f63-baef-0794070f9775): created successfully Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91ce8de-2aff-46ab-824d-839cd8d6750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Flow 'volume_create_manager' (39742ad9-7b6f-4347-abd1-c048d127e4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-93a57121-02b7-453a-88f0-3472966cb2a0 tempest-VolumesMetadataTest-1892676679 None] Created volume successfully. Nov 06 21:22:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Acquiring lock "cinder-af23ab8a-8d2d-4f63-baef-0794070f9775-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Lock "cinder-af23ab8a-8d2d-4f63-baef-0794070f9775-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Acquiring lock "cinder-quobyte-af23ab8a-8d2d-4f63-baef-0794070f9775" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:22:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Lock "cinder-quobyte-af23ab8a-8d2d-4f63-baef-0794070f9775" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:22:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c4c8e5-94fe-4bcb-a337-dff0254999e9]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:40 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 Nov 06 21:22:40 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:41 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775" returned: 0 in 0.448s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:41 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775 Nov 06 21:22:41 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:41 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af23ab8a-8d2d-4f63-baef-0794070f9775" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Lock "cinder-quobyte-af23ab8a-8d2d-4f63-baef-0794070f9775" released by "delete_volume" :: held 0.958s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Created reservations ['12098675-c123-40a0-836b-1abc5e31ca20', '5590e5e7-b5f8-4ec6-9aab-e7d07b399fec', '4c3aeeb2-d8dd-4dba-8153-1f3e9ebb0d98', 'b8ae167f-2554-41b6-bd77-7f75ab988668'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:42 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:22:42 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:42 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.355s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:42 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:22:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Deleted volume successfully. Nov 06 21:22:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9abfad2f-df84-4f76-8243-07bf7263c419 tempest-VolumesMetadataTest-1892676679 None] Lock "cinder-af23ab8a-8d2d-4f63-baef-0794070f9775-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:22:51 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=65,cinder:SELECT=46,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:52 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Flow 'volume_create_manager' (10b861e1-6233-49d3-874a-cfb6ee02c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c512400-e80d-45c6-84a2-4e05b37f8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c512400-e80d-45c6-84a2-4e05b37f8e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-879541021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1886dd86-1de7-4259-8c94-c2f24f572e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccbef89ef754e6a9adedd741b026fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:53Z,use_quota=True,user_id='1481ec5264ae47d3bb0b5612b38a70b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16e09fc-e6ec-41b7-b37c-034ce7dc542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16e09fc-e6ec-41b7-b37c-034ce7dc542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2641958b-c2a4-481a-ac42-0cfd352f8b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:53 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:22:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2641958b-c2a4-481a-ac42-0cfd352f8b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1886dd86-1de7-4259-8c94-c2f24f572e48', 'volume_name': 'volume-1886dd86-1de7-4259-8c94-c2f24f572e48', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31db0b8-2da9-4c56-8d4e-4fa423f384fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31db0b8-2da9-4c56-8d4e-4fa423f384fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122f4e42-96ce-4f1f-92fd-be7008c2b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:54 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Volume 1886dd86-1de7-4259-8c94-c2f24f572e48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1886dd86-1de7-4259-8c94-c2f24f572e48', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:22:54 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Trying to clone 1886dd86-1de7-4259-8c94-c2f24f572e48 from image 0758c1e7-1e10-4850-a7cc-546025b05acd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:22:55 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:22:55 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:22:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ad0f6-6c42-4733-af83-384d086b9645]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:55 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD Nov 06 21:22:55 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd is fetched for user 1481ec5264ae47d3bb0b5612b38a70b5. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e2f62-9a7b-4403-b232-2369d6226be3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:56 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD Nov 06 21:22:56 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:56 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-879541021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1886dd86-1de7-4259-8c94-c2f24f572e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccbef89ef754e6a9adedd741b026fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:53Z,use_quota=True,user_id='1481ec5264ae47d3bb0b5612b38a70b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Creating volume 1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:57 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:57 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 1073741824 Nov 06 21:22:57 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:57 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 1073741824" returned: 0 in 0.916s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 Nov 06 21:22:58 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48" returned: 0 in 0.561s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Attempting download of 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 1886dd86-1de7-4259-8c94-c2f24f572e48. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b244d-9e76-45cc-b3a8-703f319eb89e]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Flow 'volume_create_manager' (850906fd-01c8-40d7-9e0a-e65832dfc61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490bca9b-8a8f-4366-9570-5565f3fce99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490bca9b-8a8f-4366-9570-5565f3fce99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1844512888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84264f5-33f0-4b39-8eaa-2bae961013d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba5718981fd4622b624f5ce8d84e9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:59Z,use_quota=True,user_id='6f1bc8b83f5b4c0d963f40bbd952035c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe53c232-3ace-4a27-940c-bbc0b8a657ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe53c232-3ace-4a27-940c-bbc0b8a657ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ba97dc-1454-44af-86d9-5797f761e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ba97dc-1454-44af-86d9-5797f761e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84264f5-33f0-4b39-8eaa-2bae961013d5', 'volume_name': 'volume-e84264f5-33f0-4b39-8eaa-2bae961013d5', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6d5625-d2b2-4081-8479-8d624f137669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6d5625-d2b2-4081-8479-8d624f137669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe6f594-44d3-46ad-891d-0ee777129fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:22:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Volume e84264f5-33f0-4b39-8eaa-2bae961013d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84264f5-33f0-4b39-8eaa-2bae961013d5', 'volume_size': 1} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1844512888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84264f5-33f0-4b39-8eaa-2bae961013d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba5718981fd4622b624f5ce8d84e9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:22:59Z,use_quota=True,user_id='6f1bc8b83f5b4c0d963f40bbd952035c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Creating volume e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:22:58 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:22:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:58 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0 Nov 06 21:22:58 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:58 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 1073741824 Nov 06 21:22:58 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0" returned: 0 in 0.478s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0 Nov 06 21:22:59 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 1073741824" returned: 0 in 0.634s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 Nov 06 21:22:59 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0" returned: 1 in 0.486s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_e9j3vjy0' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f17f47-3b75-4885-a6d8-47de12c9d692]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:22:59 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD Nov 06 21:22:59 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:22:59 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5" returned: 0 in 0.355s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:22:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe6f594-44d3-46ad-891d-0ee777129fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84264f5-33f0-4b39-8eaa-2bae961013d5', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db8c2e3-78fc-4464-8a67-592710a388c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Volume volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 (e84264f5-33f0-4b39-8eaa-2bae961013d5): created successfully Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db8c2e3-78fc-4464-8a67-592710a388c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Flow 'volume_create_manager' (850906fd-01c8-40d7-9e0a-e65832dfc61e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1c16ec38-a502-4a6a-940e-238b756f7e30 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Created volume successfully. Nov 06 21:23:00 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] 0758c1e7-1e10-4850-a7cc-546025b05acd was qcow2, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:23:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:00 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 Nov 06 21:23:00 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Creating offline snapshot 7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 of volume e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[78743657-154a-49a3-b03a-85672090dd79]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:01 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 Nov 06 21:23:01 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:02 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5" returned: 0 in 0.624s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:02 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 1G Nov 06 21:23:02 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:02 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 1G" returned: 0 in 0.700s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:02 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 Nov 06 21:23:02 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:03 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48" returned: 0 in 2.809s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_1g7e1dr9devstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:23:03 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Converted 112.00 MB image at 39.86 MB/s Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:03 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 1G Nov 06 21:23:03 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:03 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" returned: 0 in 0.470s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:03 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 is being set with open permissions: ugo+rw Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:03 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 Nov 06 21:23:03 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:03 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" returned: 0 in 0.473s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:03 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info Nov 06 21:23:03 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:03 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 1G" returned: 0 in 0.744s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Downloaded image 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 1886dd86-1de7-4259-8c94-c2f24f572e48 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd for user 1481ec5264ae47d3bb0b5612b38a70b5 is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Marking volume 1886dd86-1de7-4259-8c94-c2f24f572e48 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Copying metadata from image 0758c1e7-1e10-4850-a7cc-546025b05acd to 1886dd86-1de7-4259-8c94-c2f24f572e48. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Creating volume glance metadata for volume 1886dd86-1de7-4259-8c94-c2f24f572e48 backed by image 0758c1e7-1e10-4850-a7cc-546025b05acd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122f4e42-96ce-4f1f-92fd-be7008c2b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1886dd86-1de7-4259-8c94-c2f24f572e48', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43cee7a-52b3-44b2-8009-9cd6572590e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:04 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Volume volume-1886dd86-1de7-4259-8c94-c2f24f572e48 (1886dd86-1de7-4259-8c94-c2f24f572e48): created successfully Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43cee7a-52b3-44b2-8009-9cd6572590e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Flow 'volume_create_manager' (10b861e1-6233-49d3-874a-cfb6ee02c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-efaf29a8-2d82-4270-b394-b3cfa99589c7 tempest-VolumesExtendTest-845417808 None] Created volume successfully. Nov 06 21:23:04 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info" returned: 0 in 0.416s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:04 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info is being set with open permissions: ugo+rw Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:04 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info Nov 06 21:23:04 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:04 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.info" returned: 0 in 0.724s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:04 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfbb15c-3408-4665-9364-ef6e1c6d065f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-26990e3d-9581-49cb-bc9f-e98da278aceb tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Create snapshot completed successfully Nov 06 21:23:05 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 Nov 06 21:23:05 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:05 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48" returned: 0 in 0.683s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 2G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 2G" returned: 0 in 0.138s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.877s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ffad9018-cedb-4600-909e-c0fa75b3f2a3 tempest-VolumesExtendTest-845417808 None] Extend volume completed successfully. Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "cinder-7a9b0f22-6b71-4a9e-b3c9-085ed1205e81-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-7a9b0f22-6b71-4a9e-b3c9-085ed1205e81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "cinder-quobyte-e84264f5-33f0-4b39-8eaa-2bae961013d5" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-quobyte-e84264f5-33f0-4b39-8eaa-2bae961013d5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "cinder-quobyte-7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-quobyte-7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Deleting offline snapshot 7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 of volume e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] snapshot_file for this snap is: volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29264df-b1d6-4cce-b29f-5c112ae3eea4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:06 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 Nov 06 21:23:06 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-1886dd86-1de7-4259-8c94-c2f24f572e48-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Lock "cinder-1886dd86-1de7-4259-8c94-c2f24f572e48-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-quobyte-1886dd86-1de7-4259-8c94-c2f24f572e48" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-1886dd86-1de7-4259-8c94-c2f24f572e48" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f651d0-4d72-4680-bd54-15b746d6c583]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:06 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 Nov 06 21:23:06 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:06 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" returned: 0 in 0.632s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84264f5-33f0-4b39-8eaa-2bae961013d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d69d1-007e-4657-b168-478c4e7325e3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:07 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 Nov 06 21:23:07 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:07 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48" returned: 0 in 0.474s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:07 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48 Nov 06 21:23:07 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:07 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:07 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 Nov 06 21:23:07 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:07 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1886dd86-1de7-4259-8c94-c2f24f572e48" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-1886dd86-1de7-4259-8c94-c2f24f572e48" released by "delete_volume" :: held 0.830s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Created reservations ['30b0d098-dc74-43f7-8d8c-a59ee92287ce', '662a1ad8-7ae3-493f-a1b9-8fac9f225430', 'daee8ebd-7972-47dd-915c-f4dc61e1413e', '5d12368f-7cd8-4bf8-8581-3970b420f92d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:07 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:07 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:07 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" returned: 0 in 0.529s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:08 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81 Nov 06 21:23:08 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:08 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.483s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Deleted volume successfully. Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4b4fac0e-8475-4368-afbd-ba85bb76fe5f tempest-VolumesExtendTest-845417808 None] Lock "cinder-1886dd86-1de7-4259-8c94-c2f24f572e48-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:08 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5.7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" returned: 0 in 0.505s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-quobyte-7a9b0f22-6b71-4a9e-b3c9-085ed1205e81" released by "_delete_snapshot" :: held 2.338s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-quobyte-e84264f5-33f0-4b39-8eaa-2bae961013d5" released by "delete_snapshot" :: held 2.377s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Flow 'volume_create_manager' (7b8b3a6f-f2a0-4338-bc1a-d7096499e54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046bc0d0-f720-443f-a26c-c8ff308cf0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046bc0d0-f720-443f-a26c-c8ff308cf0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-56892632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5b197e-ff20-492c-bd04-48d880f9e1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccbef89ef754e6a9adedd741b026fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:09Z,use_quota=True,user_id='1481ec5264ae47d3bb0b5612b38a70b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c4fd2-fcd5-4774-a605-617344a64227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c4fd2-fcd5-4774-a605-617344a64227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf17b860-55e3-4245-ae09-ebee57b44a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf17b860-55e3-4245-ae09-ebee57b44a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f5b197e-ff20-492c-bd04-48d880f9e1f5', 'volume_name': 'volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db21a9c-a42f-40c6-81bb-6961fff8c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db21a9c-a42f-40c6-81bb-6961fff8c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84414002-c7bc-4a92-b129-5621f8c15eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:08 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Volume 7f5b197e-ff20-492c-bd04-48d880f9e1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5', 'volume_size': 1} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-56892632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f5b197e-ff20-492c-bd04-48d880f9e1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccbef89ef754e6a9adedd741b026fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:09Z,use_quota=True,user_id='1481ec5264ae47d3bb0b5612b38a70b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Creating volume 7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:08 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:08 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 1073741824 Nov 06 21:23:08 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Created reservations ['c68f0ce4-3b61-436b-afbd-065488691aa7', '514b66b3-81b6-4094-adbc-d7d20eb64d4b', 'a9a17989-6d51-49d3-af8c-1c5b1bc90a67', '2efd47f2-7bb7-4954-ab68-34564483f68f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Delete snapshot completed successfully. Nov 06 21:23:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed63227e-51a4-43e6-b9b9-ea5b5d9d96d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-7a9b0f22-6b71-4a9e-b3c9-085ed1205e81-delete_snapshot" released by "delete_snapshot" :: held 2.799s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (db622daf-b4aa-4da4-bf44-ef31540c7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0957157c-c550-47d7-b5ad-dc94dc47cc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0957157c-c550-47d7-b5ad-dc94dc47cc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632416029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b26a969-8c67-43df-b673-024188ab9f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:09Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e895ae0a-576a-43fc-97d2-8567784b5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e895ae0a-576a-43fc-97d2-8567784b5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e3b311-e947-4bc9-9438-b36c6f262b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e3b311-e947-4bc9-9438-b36c6f262b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b26a969-8c67-43df-b673-024188ab9f74', 'volume_name': 'volume-7b26a969-8c67-43df-b673-024188ab9f74', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b64e71-7667-4b23-936c-5ac900775e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b64e71-7667-4b23-936c-5ac900775e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f672923-2166-44e9-a84d-63a827399c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Volume 7b26a969-8c67-43df-b673-024188ab9f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b26a969-8c67-43df-b673-024188ab9f74', 'volume_size': 1} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:09 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 1073741824" returned: 0 in 0.543s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:09 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 Nov 06 21:23:09 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "cinder-e84264f5-33f0-4b39-8eaa-2bae961013d5-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:09 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-e84264f5-33f0-4b39-8eaa-2bae961013d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5" returned: 0 in 0.267s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632416029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b26a969-8c67-43df-b673-024188ab9f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:09Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Creating volume 7b26a969-8c67-43df-b673-024188ab9f74 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:09 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84414002-c7bc-4a92-b129-5621f8c15eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274356d-083f-4c4c-8e40-da3cf58c190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:09 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 1073741824 Nov 06 21:23:09 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:09 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Volume volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 (7f5b197e-ff20-492c-bd04-48d880f9e1f5): created successfully Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274356d-083f-4c4c-8e40-da3cf58c190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Flow 'volume_create_manager' (7b8b3a6f-f2a0-4338-bc1a-d7096499e54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "cinder-quobyte-e84264f5-33f0-4b39-8eaa-2bae961013d5" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f0c80221-b28e-4d6e-83e4-3b15dae1c516 tempest-VolumesExtendTest-845417808 None] Created volume successfully. Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-quobyte-e84264f5-33f0-4b39-8eaa-2bae961013d5" acquired by "delete_volume" :: waited 0.039s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef1817-f888-408f-92a0-183d9451d750]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:09 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 Nov 06 21:23:09 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:10 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 1073741824" returned: 0 in 0.511s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:10 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5" returned: 0 in 0.408s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:10 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 Nov 06 21:23:10 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:10 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5 Nov 06 21:23:10 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:10 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74" returned: 0 in 0.256s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f672923-2166-44e9-a84d-63a827399c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b26a969-8c67-43df-b673-024188ab9f74', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:10 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ab38c6-274e-4185-95d0-1986248a90ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e84264f5-33f0-4b39-8eaa-2bae961013d5" returned: 0 in 0.263s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-quobyte-e84264f5-33f0-4b39-8eaa-2bae961013d5" released by "delete_volume" :: held 0.750s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:10 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Volume volume-7b26a969-8c67-43df-b673-024188ab9f74 (7b26a969-8c67-43df-b673-024188ab9f74): created successfully Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ab38c6-274e-4185-95d0-1986248a90ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (db622daf-b4aa-4da4-bf44-ef31540c7a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:10 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bdb00dcc-cd72-44f2-8b40-f0ae0236f9a7 tempest-VolumesActionsTest-1271658897 None] Created volume successfully. Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Created reservations ['5a7c8f04-6f39-4827-a1b3-17a9ca41df3d', 'b157eefc-0277-40e7-a74f-3a25010537f7', '1bb258e3-2ce9-4a0e-92af-a7b9536e5416', '9b61455a-e34d-4890-8a6a-c4471fd5498b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:10 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:10 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:10 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.333s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:10 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Deleted volume successfully. Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Creating offline snapshot be755959-801d-4bad-a3cb-6674d5b318cc of volume 7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8a38d0-b25a-4d75-8896-617519aa5c8a tempest-VolumeSnapshotQuotasNegativeTestJSON-494921738 None] Lock "cinder-e84264f5-33f0-4b39-8eaa-2bae961013d5-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237bf00-da95-4c8d-a86c-4fe0f54b323c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 Nov 06 21:23:11 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22e96ca6-fb31-49d9-8201-39924a136f4f tempest-VolumesActionsTest-1271658897 None] Acquiring lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74" by "attach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22e96ca6-fb31-49d9-8201-39924a136f4f tempest-VolumesActionsTest-1271658897 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74" acquired by "attach_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-22e96ca6-fb31-49d9-8201-39924a136f4f tempest-VolumesActionsTest-1271658897 None] Attaching volume 7b26a969-8c67-43df-b673-024188ab9f74 to instance 5fe25b55-6f3f-495a-ab7e-bcabef9b7f75 at mountpoint /dev/vdb on host None. Nov 06 21:23:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-22e96ca6-fb31-49d9-8201-39924a136f4f tempest-VolumesActionsTest-1271658897 None] Attach volume completed successfully. Nov 06 21:23:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22e96ca6-fb31-49d9-8201-39924a136f4f tempest-VolumesActionsTest-1271658897 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74" released by "attach_volume" :: held 0.251s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:11 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5" returned: 0 in 0.698s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:11 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc 1G Nov 06 21:23:11 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc 1G" returned: 0 in 0.721s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:12 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc Nov 06 21:23:12 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:12 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc" returned: 0 in 0.573s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:13 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc is being set with open permissions: ugo+rw Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:13 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc Nov 06 21:23:13 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7dde1745-93bc-4c4f-800a-cb85e2c4417f tempest-VolumesActionsTest-1738838112 None] Terminate volume connection completed successfully. Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7dde1745-93bc-4c4f-800a-cb85e2c4417f tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-detach_volume" by "detach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7dde1745-93bc-4c4f-800a-cb85e2c4417f tempest-VolumesActionsTest-1738838112 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7dde1745-93bc-4c4f-800a-cb85e2c4417f tempest-VolumesActionsTest-1738838112 None] Detaching volume 7b26a969-8c67-43df-b673-024188ab9f74 from instance 5fe25b55-6f3f-495a-ab7e-bcabef9b7f75. Nov 06 21:23:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7dde1745-93bc-4c4f-800a-cb85e2c4417f tempest-VolumesActionsTest-1738838112 None] Detach volume completed successfully. Nov 06 21:23:13 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7dde1745-93bc-4c4f-800a-cb85e2c4417f tempest-VolumesActionsTest-1738838112 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc" returned: 0 in 0.428s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:13 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info Nov 06 21:23:13 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c677e5b3-47d2-40a5-b3f3-0c0a60b594c5 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-detach_volume" by "detach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c677e5b3-47d2-40a5-b3f3-0c0a60b594c5 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c677e5b3-47d2-40a5-b3f3-0c0a60b594c5 tempest-VolumesActionsTest-1271658897 None] Volume detach called, but volume not attached. Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c677e5b3-47d2-40a5-b3f3-0c0a60b594c5 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:13 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info" returned: 0 in 0.484s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:13 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info is being set with open permissions: ugo+rw Nov 06 21:23:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info Nov 06 21:23:14 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:14 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.info" returned: 0 in 0.408s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.512s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "cinder-quobyte-7b26a969-8c67-43df-b673-024188ab9f74" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ce92afd4-ce45-4a09-86ec-29ef31b5c5c2 tempest-VolumesExtendTest-845417808 None] Create snapshot completed successfully Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-quobyte-7b26a969-8c67-43df-b673-024188ab9f74" acquired by "delete_volume" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[158cd58b-1cf6-40e5-9ae0-75cb4a5814cc]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 Nov 06 21:23:14 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:14 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74" returned: 0 in 0.400s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:14 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74 Nov 06 21:23:14 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:15 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7b26a969-8c67-43df-b673-024188ab9f74" returned: 0 in 0.419s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-quobyte-7b26a969-8c67-43df-b673-024188ab9f74" released by "delete_volume" :: held 0.885s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6143da-e0a5-4cae-8d37-bab8c3d77592]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Created reservations ['551a00db-794c-4c3c-b14a-86fee2d43be5', 'c8d65a19-64a2-4425-90a8-9a665d3e913f', '6601b751-6c50-4df9-86bd-392cf4df3828', 'ed77c960-fd1e-4162-9b07-059d77adcc6e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:15 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 Nov 06 21:23:15 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:15 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:15 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:16 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.317s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Deleted volume successfully. Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d569ef3b-1c75-4ce0-9b24-20a11f928658 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-7b26a969-8c67-43df-b673-024188ab9f74-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:16 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5" returned: 0 in 0.688s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc 2G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc 2G" returned: 0 in 0.154s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.938s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8d284064-02cc-45e4-8209-5d5cf4a65d6a tempest-VolumesExtendTest-845417808 None] Extend volume completed successfully. Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-be755959-801d-4bad-a3cb-6674d5b318cc-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Lock "cinder-be755959-801d-4bad-a3cb-6674d5b318cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-quobyte-7f5b197e-ff20-492c-bd04-48d880f9e1f5" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-7f5b197e-ff20-492c-bd04-48d880f9e1f5" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-quobyte-be755959-801d-4bad-a3cb-6674d5b318cc" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-be755959-801d-4bad-a3cb-6674d5b318cc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Deleting offline snapshot be755959-801d-4bad-a3cb-6674d5b318cc of volume 7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] snapshot_file for this snap is: volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e26ee0-288e-4458-a6ac-a9cf2c2d7941]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:17 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc Nov 06 21:23:17 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:17 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc" returned: 0 in 0.682s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:23:17 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8dd20-b9d9-4ab4-b22d-ffc0d99bfd86]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:17 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 Nov 06 21:23:17 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:18 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5" returned: 0 in 0.549s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:18 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc Nov 06 21:23:18 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Flow 'volume_create_manager' (d268b30f-c923-4f15-8a56-7b9e3e0f3ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b4c20f-61ff-4232-a025-b2d379b92566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b4c20f-61ff-4232-a025-b2d379b92566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-893171104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5310471a-c6ec-46be-9974-6f3eaf9d83e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06ce1b310964287a136791add3b313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:18Z,use_quota=True,user_id='ed5ebf59e14649b9a3b6b5a181fe40c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5137524-c45f-4aa3-a7b7-7cfa5c2d5db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5137524-c45f-4aa3-a7b7-7cfa5c2d5db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fc5976-e35f-4d9c-b12a-543576c05d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fc5976-e35f-4d9c-b12a-543576c05d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5310471a-c6ec-46be-9974-6f3eaf9d83e9', 'volume_name': 'volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af76d501-350b-4122-96bd-55899c4d2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af76d501-350b-4122-96bd-55899c4d2dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837ade2e-ea88-4bd1-944c-ae11d1343b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:18 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Volume 5310471a-c6ec-46be-9974-6f3eaf9d83e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9', 'volume_size': 1} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-893171104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5310471a-c6ec-46be-9974-6f3eaf9d83e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06ce1b310964287a136791add3b313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:18Z,use_quota=True,user_id='ed5ebf59e14649b9a3b6b5a181fe40c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Creating volume 5310471a-c6ec-46be-9974-6f3eaf9d83e9 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:18 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:18 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 1073741824 Nov 06 21:23:18 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:18 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc" returned: 0 in 0.567s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:18 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc Nov 06 21:23:18 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 1073741824" returned: 0 in 0.672s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:19 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 Nov 06 21:23:19 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:19 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5.be755959-801d-4bad-a3cb-6674d5b318cc" returned: 0 in 0.451s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-be755959-801d-4bad-a3cb-6674d5b318cc" released by "_delete_snapshot" :: held 2.443s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-7f5b197e-ff20-492c-bd04-48d880f9e1f5" released by "delete_snapshot" :: held 2.484s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Created reservations ['03fa67ff-99f0-4f9c-beb3-a1008760bf9b', 'bc6da48f-eb83-4bc8-a66b-0126165a2004', '71d786e4-5ec5-4b72-a4cc-17260315acb7', '135e4041-b101-460f-b881-e69a4056a24f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:19 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9" returned: 0 in 0.342s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837ade2e-ea88-4bd1-944c-ae11d1343b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f350bbf-af41-455a-9ec9-2eb2b188c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Delete snapshot completed successfully. Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b264282d-c978-4e27-ac02-4a3d41f7ec63 tempest-VolumesExtendTest-845417808 None] Lock "cinder-be755959-801d-4bad-a3cb-6674d5b318cc-delete_snapshot" released by "delete_snapshot" :: held 2.760s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:19 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Volume volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 (5310471a-c6ec-46be-9974-6f3eaf9d83e9): created successfully Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f350bbf-af41-455a-9ec9-2eb2b188c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Flow 'volume_create_manager' (d268b30f-c923-4f15-8a56-7b9e3e0f3ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f93ff1c3-fa59-4e05-9cd0-67833fcdced7 tempest-AttachVolumeNegativeTest-1471779740 None] Created volume successfully. Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-7f5b197e-ff20-492c-bd04-48d880f9e1f5-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Lock "cinder-7f5b197e-ff20-492c-bd04-48d880f9e1f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Acquiring lock "cinder-quobyte-7f5b197e-ff20-492c-bd04-48d880f9e1f5" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-7f5b197e-ff20-492c-bd04-48d880f9e1f5" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db00f7-00c4-4f83-919a-e4384bb68703]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 Nov 06 21:23:20 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5" returned: 0 in 0.507s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:20 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5 Nov 06 21:23:20 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (a2da9fea-0ed1-42a3-ab0d-3b32d87d143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a5150f-cb69-4b6a-9e57-5dcee336b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a5150f-cb69-4b6a-9e57-5dcee336b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-475254631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa076f8c-fa62-4a02-913c-85bfa4604ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:21Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc33a50-e6a0-43da-9025-35309e9dfb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc33a50-e6a0-43da-9025-35309e9dfb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f323b3e-e83d-4c2b-8832-1cc62dfba28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f323b3e-e83d-4c2b-8832-1cc62dfba28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa076f8c-fa62-4a02-913c-85bfa4604ebd', 'volume_name': 'volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880d20aa-49e2-4702-ab1c-1aeaa58e5e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880d20aa-49e2-4702-ab1c-1aeaa58e5e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024af114-466d-4246-9527-f77f82fb632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:20 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Volume aa076f8c-fa62-4a02-913c-85bfa4604ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd', 'volume_size': 1} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-475254631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa076f8c-fa62-4a02-913c-85bfa4604ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:21Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Creating volume aa076f8c-fa62-4a02-913c-85bfa4604ebd {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:21 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:21 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd 1073741824 Nov 06 21:23:21 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:21 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7f5b197e-ff20-492c-bd04-48d880f9e1f5" returned: 0 in 0.304s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Lock "cinder-quobyte-7f5b197e-ff20-492c-bd04-48d880f9e1f5" released by "delete_volume" :: held 0.903s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Created reservations ['0cc29fa7-87c0-4007-b5d0-bf9fa96493ec', '789dfa19-d71e-44c0-bc4c-bb950f68d9f0', '518a3131-7339-47d4-886c-a8cb34017d3f', '21555805-85c3-4a5a-bbbc-31657f9ddd20'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:21 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:21 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:21 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.375s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Deleted volume successfully. Nov 06 21:23:21 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd 1073741824" returned: 0 in 0.714s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77024270-3bda-460e-9354-257e90fd4883 tempest-VolumesExtendTest-845417808 None] Lock "cinder-7f5b197e-ff20-492c-bd04-48d880f9e1f5-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-02927119-d300-4377-9270-264ebdcffe12 req-86d3fabc-8bec-4ff0-bc17-6bf9da41ae38 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:21 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd Nov 06 21:23:21 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:22 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd" returned: 0 in 0.260s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-02927119-d300-4377-9270-264ebdcffe12 req-86d3fabc-8bec-4ff0-bc17-6bf9da41ae38 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.276s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024af114-466d-4246-9527-f77f82fb632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e7a692-7a4f-419c-a2f6-624d38e3566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-02927119-d300-4377-9270-264ebdcffe12 req-86d3fabc-8bec-4ff0-bc17-6bf9da41ae38 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:22 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Volume volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd (aa076f8c-fa62-4a02-913c-85bfa4604ebd): created successfully Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e7a692-7a4f-419c-a2f6-624d38e3566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (a2da9fea-0ed1-42a3-ab0d-3b32d87d143b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ee00686d-8adb-416d-8158-8b9b7e31de18 tempest-VolumesActionsTest-1271658897 None] Created volume successfully. Nov 06 21:23:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-02927119-d300-4377-9270-264ebdcffe12 req-86d3fabc-8bec-4ff0-bc17-6bf9da41ae38 tempest-AttachVolumeNegativeTest-1471779740 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b7e5817-2426-469f-9379-b35a0e5f19c3', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:23:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-02927119-d300-4377-9270-264ebdcffe12 req-86d3fabc-8bec-4ff0-bc17-6bf9da41ae38 tempest-AttachVolumeNegativeTest-1471779740 None] attachment_update completed successfully. Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-aa076f8c-fa62-4a02-913c-85bfa4604ebd-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-aa076f8c-fa62-4a02-913c-85bfa4604ebd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-quobyte-aa076f8c-fa62-4a02-913c-85bfa4604ebd" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-aa076f8c-fa62-4a02-913c-85bfa4604ebd" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7230cd00-3f66-4a32-b3b9-955a03e322e0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:23 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd Nov 06 21:23:23 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:23 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd" returned: 0 in 0.585s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:23 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd Nov 06 21:23:23 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:24 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa076f8c-fa62-4a02-913c-85bfa4604ebd" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-aa076f8c-fa62-4a02-913c-85bfa4604ebd" released by "delete_volume" :: held 1.034s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Created reservations ['6a1566af-60c5-4774-bc51-37bfeb1dd0fb', '500ddfd8-2dba-4dc6-929f-bb815e7971b9', '6fc695f8-eb1f-4f85-b22d-d64472adb196', 'dae6a564-5e5a-4f1d-a7de-f65f417a6852'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:24 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:24 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:24 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.306s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:24 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Deleted volume successfully. Nov 06 21:23:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c0d354d4-3074-48d8-abec-bc23f5248524 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-aa076f8c-fa62-4a02-913c-85bfa4604ebd-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-f8312f6b-8573-464a-a88b-a51d775a5593 req-e5df46af-e653-4fd9-9651-e143375c93c2 tempest-AttachVolumeNegativeTest-1471779740 None] Terminate volume connection completed successfully. Nov 06 21:23:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-f8312f6b-8573-464a-a88b-a51d775a5593 req-e5df46af-e653-4fd9-9651-e143375c93c2 tempest-AttachVolumeNegativeTest-1471779740 None] Deleting attachment 6b7e5817-2426-469f-9379-b35a0e5f19c3. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (ee22050e-dacb-4054-8b99-6d5c43933a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2d3665-b18b-4e93-b7fa-1db24600ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2d3665-b18b-4e93-b7fa-1db24600ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233441222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69facb7-2c0f-4d1a-82c1-c85b405a0cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:26Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db4e71c-3daa-4a2e-8c6e-bf49a61987de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db4e71c-3daa-4a2e-8c6e-bf49a61987de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34a5c20-e30f-42c9-bafb-c80418b81753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34a5c20-e30f-42c9-bafb-c80418b81753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69facb7-2c0f-4d1a-82c1-c85b405a0cf9', 'volume_name': 'volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd108961-634c-4944-a464-0fac0b3f76b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd108961-634c-4944-a464-0fac0b3f76b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69a1831-5645-4a68-8a76-d2561b403f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Volume b69facb7-2c0f-4d1a-82c1-c85b405a0cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9', 'volume_size': 1} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233441222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69facb7-2c0f-4d1a-82c1-c85b405a0cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:26Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Creating volume b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:26 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 1073741824 Nov 06 21:23:26 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:27 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 1073741824" returned: 0 in 0.845s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:27 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 Nov 06 21:23:27 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:27 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9" returned: 0 in 0.374s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69a1831-5645-4a68-8a76-d2561b403f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cb256c-24cc-4da3-8268-dc05f93aac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Volume volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 (b69facb7-2c0f-4d1a-82c1-c85b405a0cf9): created successfully Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cb256c-24cc-4da3-8268-dc05f93aac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (ee22050e-dacb-4054-8b99-6d5c43933a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3c35beab-190b-4ef2-980e-0ee8d91c9b11 tempest-VolumesActionsTest-1271658897 None] Created volume successfully. Nov 06 21:23:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Lock "cinder-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-quobyte-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3286e4-308d-4b7c-9e19-cab8e287bda0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:28 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 Nov 06 21:23:28 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:29 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Flow 'volume_create_manager' (d2263f87-1e2a-4188-83eb-cc3d741024b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b46097-0603-4421-9fdd-55f1894568f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9" returned: 0 in 0.478s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b46097-0603-4421-9fdd-55f1894568f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1505757881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87e2196-5f40-4e6b-ad4b-0a0caad82466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5057a3bd684b7aa1aa6b38d8bbeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:29Z,use_quota=True,user_id='1775baca84f344ddb0fa035a3f5ac52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9 Nov 06 21:23:29 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68a1fe7-c3c6-4889-90b2-49f8fad4820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68a1fe7-c3c6-4889-90b2-49f8fad4820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b82235-3ccd-4133-852d-e36d0e27dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b82235-3ccd-4133-852d-e36d0e27dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87e2196-5f40-4e6b-ad4b-0a0caad82466', 'volume_name': 'volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cad55e-fd97-459f-bbe3-d51a6e41e7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cad55e-fd97-459f-bbe3-d51a6e41e7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f763c03-1001-45ea-a96b-776ca6e09826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Volume d87e2196-5f40-4e6b-ad4b-0a0caad82466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466', 'volume_size': 1} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1505757881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87e2196-5f40-4e6b-ad4b-0a0caad82466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5057a3bd684b7aa1aa6b38d8bbeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:29Z,use_quota=True,user_id='1775baca84f344ddb0fa035a3f5ac52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Creating volume d87e2196-5f40-4e6b-ad4b-0a0caad82466 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:29 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:29 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 1073741824 Nov 06 21:23:29 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:29 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9" returned: 0 in 0.332s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9" released by "delete_volume" :: held 0.885s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Created reservations ['15d6c657-6cd6-46c3-89a3-fc5f1cfd3db6', '0a35ccc5-f0f2-46f8-9c80-50fd0bddc716', 'd6fc7974-3472-4073-9735-3e3a1ec1f67b', '2c649c04-ca96-4396-b4ff-878a6c5824e3'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:29 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:29 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:29 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 1073741824" returned: 0 in 0.688s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:30 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 Nov 06 21:23:30 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:30 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.377s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Deleted volume successfully. Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-98e6bf9f-e714-40d9-a36b-f9c7c04547fe tempest-VolumesActionsTest-1738838112 None] Lock "cinder-b69facb7-2c0f-4d1a-82c1-c85b405a0cf9-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:30 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466" returned: 0 in 0.424s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f763c03-1001-45ea-a96b-776ca6e09826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f1f943-1809-45b8-a76e-4f55228eb673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Volume volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 (d87e2196-5f40-4e6b-ad4b-0a0caad82466): created successfully Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f1f943-1809-45b8-a76e-4f55228eb673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Flow 'volume_create_manager' (d2263f87-1e2a-4188-83eb-cc3d741024b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-976b27c5-b168-495c-a53f-1d9d3d72bf60 tempest-VolumesListAdminTestJSON-1972566161 None] Created volume successfully. Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (c6eb7ab0-d0d3-41eb-8168-41a434221388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fb0675-b04d-429a-82f1-5a4bfb6fb779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fb0675-b04d-429a-82f1-5a4bfb6fb779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415345165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47c0885-c104-481e-974f-d7121652e80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:31Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0b0f0c-d93a-4665-8bb3-e46264379c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0b0f0c-d93a-4665-8bb3-e46264379c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1f222-5fe6-4458-8a25-6a98cddad64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1f222-5fe6-4458-8a25-6a98cddad64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47c0885-c104-481e-974f-d7121652e80e', 'volume_name': 'volume-d47c0885-c104-481e-974f-d7121652e80e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91eadc1-785f-4b94-ba63-033b3cf50280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91eadc1-785f-4b94-ba63-033b3cf50280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe009e1-4965-46dd-9e21-f9c20c2a9aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Volume d47c0885-c104-481e-974f-d7121652e80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47c0885-c104-481e-974f-d7121652e80e', 'volume_size': 1} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415345165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47c0885-c104-481e-974f-d7121652e80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:31Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Creating volume d47c0885-c104-481e-974f-d7121652e80e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:30 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:30 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e 1073741824 Nov 06 21:23:30 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:31 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e 1073741824" returned: 0 in 0.620s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:31 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e Nov 06 21:23:31 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:31 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e" returned: 0 in 0.373s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe009e1-4965-46dd-9e21-f9c20c2a9aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47c0885-c104-481e-974f-d7121652e80e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a6e696-707d-4d98-983f-1c83eb108e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Volume volume-d47c0885-c104-481e-974f-d7121652e80e (d47c0885-c104-481e-974f-d7121652e80e): created successfully Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a6e696-707d-4d98-983f-1c83eb108e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (c6eb7ab0-d0d3-41eb-8168-41a434221388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9f8fbd17-170f-43e0-887c-abff5db96c45 tempest-VolumesActionsTest-1271658897 None] Created volume successfully. Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Flow 'volume_create_manager' (c3eb169f-e21c-4569-97d6-87fd0248cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb3c514-b626-465f-8937-9b0828dbdd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb3c514-b626-465f-8937-9b0828dbdd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2094819060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea60b6ca-8556-45e3-b0ed-6903200fdb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5057a3bd684b7aa1aa6b38d8bbeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:32Z,use_quota=True,user_id='1775baca84f344ddb0fa035a3f5ac52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac118f6b-28e0-40f1-8a31-428c3863e3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac118f6b-28e0-40f1-8a31-428c3863e3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202240f0-ff79-4547-8e73-c0d143b4be8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202240f0-ff79-4547-8e73-c0d143b4be8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea60b6ca-8556-45e3-b0ed-6903200fdb9a', 'volume_name': 'volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cbf222-019f-49ea-8430-2b6e2534a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31cbf222-019f-49ea-8430-2b6e2534a291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3486beb-79e5-45dc-a1f4-3ee31247bfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:32 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Volume ea60b6ca-8556-45e3-b0ed-6903200fdb9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a', 'volume_size': 1} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2094819060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea60b6ca-8556-45e3-b0ed-6903200fdb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5057a3bd684b7aa1aa6b38d8bbeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:32Z,use_quota=True,user_id='1775baca84f344ddb0fa035a3f5ac52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Creating volume ea60b6ca-8556-45e3-b0ed-6903200fdb9a {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:32 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:32 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a 1073741824 Nov 06 21:23:32 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:32 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:32 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:32 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.335s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 28 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:23:32 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a 1073741824" returned: 0 in 0.669s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:32 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a Nov 06 21:23:32 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-d47c0885-c104-481e-974f-d7121652e80e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-d47c0885-c104-481e-974f-d7121652e80e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-quobyte-d47c0885-c104-481e-974f-d7121652e80e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-d47c0885-c104-481e-974f-d7121652e80e" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52d3c90-f2c1-40ce-98ba-a546b7b2c8f8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:33 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e Nov 06 21:23:33 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:33 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a" returned: 0 in 0.413s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3486beb-79e5-45dc-a1f4-3ee31247bfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f862e96b-2649-4c8d-8ba5-c1469d3f92e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:33 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Volume volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a (ea60b6ca-8556-45e3-b0ed-6903200fdb9a): created successfully Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f862e96b-2649-4c8d-8ba5-c1469d3f92e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Flow 'volume_create_manager' (c3eb169f-e21c-4569-97d6-87fd0248cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-361ea751-d0f2-495d-bead-b36635f4fb70 tempest-VolumesListAdminTestJSON-1972566161 None] Created volume successfully. Nov 06 21:23:33 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e" returned: 0 in 0.423s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:33 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e Nov 06 21:23:33 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:33 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d47c0885-c104-481e-974f-d7121652e80e" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-d47c0885-c104-481e-974f-d7121652e80e" released by "delete_volume" :: held 0.745s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Created reservations ['7dd4ca85-4642-490a-b1d1-e1e5a86758d9', '7b97fd2e-de3f-4f43-b433-3a0a5fbb11d3', 'c4448c61-1a7e-4b9d-8000-090ac788fedb', '1ff1c387-8612-4a8f-967a-efccca216c95'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:33 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:33 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:34 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.505s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:34 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Deleted volume successfully. Nov 06 21:23:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6c026009-a7e0-401d-ba7c-fd3b95132fc5 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-d47c0885-c104-481e-974f-d7121652e80e-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Flow 'volume_create_manager' (77914a30-0e95-4800-b669-e1b01f1f6df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3c3a26-a772-4f6f-a573-82eb4a67d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3c3a26-a772-4f6f-a573-82eb4a67d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1518362511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5334c391-5fde-4f19-bc6b-e74876b27837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5057a3bd684b7aa1aa6b38d8bbeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:35Z,use_quota=True,user_id='1775baca84f344ddb0fa035a3f5ac52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab293b5-6b03-4946-bc5e-69f97bae3e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab293b5-6b03-4946-bc5e-69f97bae3e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75993f7-29e5-497c-abe0-26d2026c6d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75993f7-29e5-497c-abe0-26d2026c6d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5334c391-5fde-4f19-bc6b-e74876b27837', 'volume_name': 'volume-5334c391-5fde-4f19-bc6b-e74876b27837', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6175cc70-cf55-44ab-8510-39e734c1ef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6175cc70-cf55-44ab-8510-39e734c1ef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847f5121-8c5d-4201-8973-668111cd26b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Volume 5334c391-5fde-4f19-bc6b-e74876b27837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5334c391-5fde-4f19-bc6b-e74876b27837', 'volume_size': 1} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1518362511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5334c391-5fde-4f19-bc6b-e74876b27837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5057a3bd684b7aa1aa6b38d8bbeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:35Z,use_quota=True,user_id='1775baca84f344ddb0fa035a3f5ac52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Creating volume 5334c391-5fde-4f19-bc6b-e74876b27837 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:35 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:35 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 1073741824 Nov 06 21:23:35 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (89e10221-7776-4cce-afac-39610bb1370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7dcfca-d43d-48f8-b763-122d915f7f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7dcfca-d43d-48f8-b763-122d915f7f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-228196653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:35Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c024ac-a481-4f5a-a77f-a28e74d8efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c024ac-a481-4f5a-a77f-a28e74d8efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7038059f-342e-4198-8f5c-297ef586d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7038059f-342e-4198-8f5c-297ef586d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a', 'volume_name': 'volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439ab73a-3990-462e-9316-492972bc744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439ab73a-3990-462e-9316-492972bc744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b80492-75a8-48aa-8a4a-00cf9c3386c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Volume c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a', 'volume_size': 1} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:35 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 1073741824" returned: 0 in 0.654s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:35 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 Nov 06 21:23:35 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837" returned: 0 in 0.303s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-228196653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:35Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Creating volume c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:36 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847f5121-8c5d-4201-8973-668111cd26b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5334c391-5fde-4f19-bc6b-e74876b27837', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e161bb-30e2-4a0e-9fec-3f0b2cfa07f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:36 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a 1073741824 Nov 06 21:23:36 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:36 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Volume volume-5334c391-5fde-4f19-bc6b-e74876b27837 (5334c391-5fde-4f19-bc6b-e74876b27837): created successfully Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e161bb-30e2-4a0e-9fec-3f0b2cfa07f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Flow 'volume_create_manager' (77914a30-0e95-4800-b669-e1b01f1f6df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-67014b99-f49a-43ea-a3b5-6de3b0ccccfc tempest-VolumesListAdminTestJSON-1972566161 None] Created volume successfully. Nov 06 21:23:36 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a 1073741824" returned: 0 in 0.709s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:37 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a Nov 06 21:23:37 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:37 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a" returned: 0 in 0.349s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b80492-75a8-48aa-8a4a-00cf9c3386c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2278a4-8e47-49a5-a156-7bdff65e706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Volume volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a (c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a): created successfully Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2278a4-8e47-49a5-a156-7bdff65e706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (89e10221-7776-4cce-afac-39610bb1370b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4de0bc65-eb7d-4a51-a39e-c7357dcea843 tempest-VolumesActionsTest-1271658897 None] Created volume successfully. Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Flow 'volume_create_manager' (952fb889-eaf3-4016-8cd6-27618ab9ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ade4ba-eff3-4b45-bce5-dd447c35a006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ade4ba-eff3-4b45-bce5-dd447c35a006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8352c68-6c96-476d-9113-c82f58383772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5ac3166371479f8d19fad073bfbd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:38Z,use_quota=True,user_id='6896910037b04aaca1946628b1056cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03df931c-0fa6-4756-ab43-b9800db97090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03df931c-0fa6-4756-ab43-b9800db97090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb7493f-3feb-49b5-93d4-58410f41399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb7493f-3feb-49b5-93d4-58410f41399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8352c68-6c96-476d-9113-c82f58383772', 'volume_name': 'volume-c8352c68-6c96-476d-9113-c82f58383772', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aba6ac-3fcf-42cf-9fe8-4e119a622e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aba6ac-3fcf-42cf-9fe8-4e119a622e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02be2493-d57d-4671-94e0-cbb4f74f9535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Volume c8352c68-6c96-476d-9113-c82f58383772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8352c68-6c96-476d-9113-c82f58383772', 'volume_size': 1} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8352c68-6c96-476d-9113-c82f58383772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5ac3166371479f8d19fad073bfbd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:38Z,use_quota=True,user_id='6896910037b04aaca1946628b1056cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Creating volume c8352c68-6c96-476d-9113-c82f58383772 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:38 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 1073741824 Nov 06 21:23:38 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "cinder-quobyte-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95b14f-da72-447f-a1f8-2ea167028b1b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:38 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a Nov 06 21:23:38 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:38 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 1073741824" returned: 0 in 0.620s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:38 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 Nov 06 21:23:38 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:39 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a" returned: 0 in 0.542s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:39 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a Nov 06 21:23:39 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:39 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772" returned: 0 in 0.402s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02be2493-d57d-4671-94e0-cbb4f74f9535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8352c68-6c96-476d-9113-c82f58383772', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b532af0-4866-49ec-af8c-5c6760151801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Volume volume-c8352c68-6c96-476d-9113-c82f58383772 (c8352c68-6c96-476d-9113-c82f58383772): created successfully Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b532af0-4866-49ec-af8c-5c6760151801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Flow 'volume_create_manager' (952fb889-eaf3-4016-8cd6-27618ab9ad09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-488160a7-e964-4bba-9f52-430b8dc37f6e tempest-VolumesListAdminTestJSON-981326859 None] Created volume successfully. Nov 06 21:23:39 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a" returned: 0 in 0.337s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-quobyte-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a" released by "delete_volume" :: held 0.935s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Created reservations ['62f21c5e-ed8c-4215-be5f-592eb25febc8', 'c7ce607f-e21e-4c85-a8bd-3a359973fa68', '09452820-8a4e-4d8c-95e5-f414fd1069b0', 'd59ac9bf-93a5-4f65-8e60-baa1f4cbf3f6'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:39 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:39 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:39 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.300s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Deleted volume successfully. Nov 06 21:23:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2236bae-03fc-4c7d-a88a-a13d186b70a9 tempest-VolumesActionsTest-1738838112 None] Lock "cinder-c475ccb9-6c8c-4e27-9bf1-c1f08d3cd17a-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (925c76c1-c764-4933-a232-1c438b56c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c71cf33-ee19-4909-b118-42af71209f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Acquiring lock "cinder-c8352c68-6c96-476d-9113-c82f58383772-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c71cf33-ee19-4909-b118-42af71209f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-146240558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b34939b-d05a-4f92-92d9-ec6ecc1120e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:40Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e277a6c8-6096-48ca-846b-454451b64eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e277a6c8-6096-48ca-846b-454451b64eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5153833-ae31-44c3-be2f-dbe92500345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5153833-ae31-44c3-be2f-dbe92500345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b34939b-d05a-4f92-92d9-ec6ecc1120e9', 'volume_name': 'volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f910d5d-0b01-4909-8ee7-2ac88a44b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f910d5d-0b01-4909-8ee7-2ac88a44b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455a322e-c8fc-408b-b8ed-c0f510d30a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:40 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Volume 4b34939b-d05a-4f92-92d9-ec6ecc1120e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9', 'volume_size': 1} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-146240558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b34939b-d05a-4f92-92d9-ec6ecc1120e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fae6d803fb4a878fdc170b84a74b4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:23:40Z,use_quota=True,user_id='22a35b0285c34c8ebc298442b9b6e00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Creating volume 4b34939b-d05a-4f92-92d9-ec6ecc1120e9 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:23:40 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "cinder-5334c391-5fde-4f19-bc6b-e74876b27837-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:40 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 1073741824 Nov 06 21:23:40 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Lock "cinder-c8352c68-6c96-476d-9113-c82f58383772-delete_volume" acquired by "delete_volume" :: waited 0.229s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-5334c391-5fde-4f19-bc6b-e74876b27837-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Acquiring lock "cinder-quobyte-c8352c68-6c96-476d-9113-c82f58383772" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Lock "cinder-quobyte-c8352c68-6c96-476d-9113-c82f58383772" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "cinder-quobyte-5334c391-5fde-4f19-bc6b-e74876b27837" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14ecd09-1f31-4a0f-92fd-3f291b1837ea]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-quobyte-5334c391-5fde-4f19-bc6b-e74876b27837" acquired by "delete_volume" :: waited 0.078s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[77646867-5391-4aec-8df5-0c9b535da0b6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:41 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 Nov 06 21:23:41 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 Nov 06 21:23:41 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 1073741824" returned: 0 in 0.831s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:41 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772" returned: 0 in 0.661s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:41 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 Nov 06 21:23:41 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772 Nov 06 21:23:41 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837" returned: 0 in 0.708s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:41 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837 Nov 06 21:23:41 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:41 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9" returned: 0 in 0.461s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455a322e-c8fc-408b-b8ed-c0f510d30a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c1d56d-d777-45c3-a979-335c256f3761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:23:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Volume volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 (4b34939b-d05a-4f92-92d9-ec6ecc1120e9): created successfully Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c1d56d-d777-45c3-a979-335c256f3761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:23:42 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Flow 'volume_create_manager' (925c76c1-c764-4933-a232-1c438b56c014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8352c68-6c96-476d-9113-c82f58383772" returned: 0 in 0.555s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Lock "cinder-quobyte-c8352c68-6c96-476d-9113-c82f58383772" released by "delete_volume" :: held 1.314s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-784aa12a-429e-45a1-9dea-765e1db3c318 tempest-VolumesActionsTest-1271658897 None] Created volume successfully. Nov 06 21:23:42 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5334c391-5fde-4f19-bc6b-e74876b27837" returned: 0 in 0.555s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Created reservations ['5144313b-2695-4826-a28b-b87a7205f8d2', '01e4211c-4a24-4299-b90d-8de140b033d6', '43bb0cde-eab6-434c-9ded-bab47c8a108b', '90bc4bd3-8aa5-43e1-ba37-97f62cf387b7'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-quobyte-5334c391-5fde-4f19-bc6b-e74876b27837" released by "delete_volume" :: held 1.373s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Created reservations ['a4dbb1f4-5622-4b3b-bc25-fb888676fe03', '524e043d-91a3-4384-b400-985675499b8e', '01fea5b7-7f18-4fc0-ac7d-6dfe50456563', '9bfbcd34-4c15-48c9-978c-0ea48a62e453'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:42 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:42 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:43 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.519s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:43 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:43 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Deleted volume successfully. Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0a639598-e02c-4b13-bee7-e95d9e38072f tempest-VolumesListAdminTestJSON-981326859 None] Lock "cinder-c8352c68-6c96-476d-9113-c82f58383772-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "cinder-ea60b6ca-8556-45e3-b0ed-6903200fdb9a-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-ea60b6ca-8556-45e3-b0ed-6903200fdb9a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "cinder-quobyte-ea60b6ca-8556-45e3-b0ed-6903200fdb9a" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-quobyte-ea60b6ca-8556-45e3-b0ed-6903200fdb9a" acquired by "delete_volume" :: waited 0.042s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[364fea4e-ad38-4062-94e7-85c85e08c3ad]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:43 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.811s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Deleted volume successfully. Nov 06 21:23:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4a2ffc1f-7a7f-48fa-9afe-3bb80e4e33fc tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-5334c391-5fde-4f19-bc6b-e74876b27837-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:43 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a Nov 06 21:23:43 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "cinder-4b34939b-d05a-4f92-92d9-ec6ecc1120e9-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-4b34939b-d05a-4f92-92d9-ec6ecc1120e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:44 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a" returned: 0 in 0.839s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "cinder-quobyte-4b34939b-d05a-4f92-92d9-ec6ecc1120e9" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:44 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a Nov 06 21:23:44 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-quobyte-4b34939b-d05a-4f92-92d9-ec6ecc1120e9" acquired by "delete_volume" :: waited 0.045s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88de211-75b4-405d-a55b-47e1a90dfd6c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:44 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 Nov 06 21:23:44 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:44 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ea60b6ca-8556-45e3-b0ed-6903200fdb9a" returned: 0 in 0.445s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-quobyte-ea60b6ca-8556-45e3-b0ed-6903200fdb9a" released by "delete_volume" :: held 1.409s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Created reservations ['a03de486-fd43-49a1-88f9-bd33335fd146', '3939fb8e-5f3c-47bb-b5e1-ed5bbe5006da', '701eb4e6-41db-4885-b962-a6b9e5d5aa59', 'b93fddc9-d458-47b6-a02b-c8ee9d26f136'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:45 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9" returned: 0 in 0.539s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:45 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:45 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:45 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9 Nov 06 21:23:45 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:45 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.367s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Deleted volume successfully. Nov 06 21:23:45 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4b34939b-d05a-4f92-92d9-ec6ecc1120e9" returned: 0 in 0.381s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ea8cf82-3d0f-4d72-adcc-0eb7f8ae73c0 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-ea60b6ca-8556-45e3-b0ed-6903200fdb9a-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-quobyte-4b34939b-d05a-4f92-92d9-ec6ecc1120e9" released by "delete_volume" :: held 0.994s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Created reservations ['3230e418-e684-4970-aa88-60aa13125f8f', 'd2b9c4c4-4092-40b9-9545-21dc978b72ac', '1a93e1ed-0751-493f-88fc-f9e3c173d975', 'f940fabf-026b-4457-9b5c-ab5dc9095a88'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:45 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:45 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "cinder-d87e2196-5f40-4e6b-ad4b-0a0caad82466-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-d87e2196-5f40-4e6b-ad4b-0a0caad82466-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "cinder-quobyte-d87e2196-5f40-4e6b-ad4b-0a0caad82466" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-quobyte-d87e2196-5f40-4e6b-ad4b-0a0caad82466" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:23:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5104f8-644a-4cd5-9ba4-4050c18c603c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:46 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Deleted volume successfully. Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c74ba004-5e1a-413c-828e-e46abc4f81b9 tempest-VolumesActionsTest-1271658897 None] Lock "cinder-4b34939b-d05a-4f92-92d9-ec6ecc1120e9-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:46 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 Nov 06 21:23:46 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:46 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466" returned: 0 in 0.410s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:46 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466 Nov 06 21:23:46 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:46 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d87e2196-5f40-4e6b-ad4b-0a0caad82466" returned: 0 in 0.511s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-quobyte-d87e2196-5f40-4e6b-ad4b-0a0caad82466" released by "delete_volume" :: held 0.982s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Created reservations ['5e4b2ac2-5baa-4b40-b937-889681feb058', '0263a47e-9355-4761-8148-99913e4149ed', 'b7075c78-68c2-4333-9eb8-672ba05f5103', '0ddbb374-5b43-4ad0-84b9-1e2f9c4eb96b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:23:47 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:23:47 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:23:47 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.384s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:23:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Deleted volume successfully. Nov 06 21:23:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d45614d9-0549-4240-a1cc-e44ead34e8e7 tempest-VolumesListAdminTestJSON-1972566161 None] Lock "cinder-d87e2196-5f40-4e6b-ad4b-0a0caad82466-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:23:57 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=178,cinder:SELECT=135,cinder:INSERT=45,cinder:DELETE=14 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:23:57 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=138,cinder:INSERT=46,cinder:UPDATE=165,cinder:DELETE=15 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Flow 'volume_create_manager' (a6cf8c1f-d7e9-4b0c-a6cd-e758e314c5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a815bc-839a-4884-a294-7e1ae7eccb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a815bc-839a-4884-a294-7e1ae7eccb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1315994235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e7135e-c606-4cd7-8886-2fdbbadfd7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06ce1b310964287a136791add3b313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:14Z,use_quota=True,user_id='ed5ebf59e14649b9a3b6b5a181fe40c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b25ce-d030-4646-8761-5010c4c480c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b25ce-d030-4646-8761-5010c4c480c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ec5e9c-6eff-491a-83b2-2bd11b5df590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ec5e9c-6eff-491a-83b2-2bd11b5df590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e7135e-c606-4cd7-8886-2fdbbadfd7f3', 'volume_name': 'volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e112df-cf30-4a3e-ade4-27f6a3c67426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e112df-cf30-4a3e-ade4-27f6a3c67426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98567689-6563-4fd6-b5a4-64fbce565d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:13 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Volume 99e7135e-c606-4cd7-8886-2fdbbadfd7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3', 'volume_size': 1} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1315994235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e7135e-c606-4cd7-8886-2fdbbadfd7f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06ce1b310964287a136791add3b313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:14Z,use_quota=True,user_id='ed5ebf59e14649b9a3b6b5a181fe40c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Creating volume 99e7135e-c606-4cd7-8886-2fdbbadfd7f3 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:13 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:13 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 1073741824 Nov 06 21:24:13 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Flow 'volume_create_manager' (fd1369ed-3d96-42cd-af96-217c664332d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cc73cf-9248-471e-b5e5-68ce4977d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cc73cf-9248-471e-b5e5-68ce4977d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1001637718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c8211a-6046-43e0-b342-eea92ccb438c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e26f71a8c141dab79011b16673f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:15Z,use_quota=True,user_id='5c0a1b441eb54a3692f5ca9c57e1cc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e776dc-dd4b-4d85-acb9-f1f06d1d1e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e776dc-dd4b-4d85-acb9-f1f06d1d1e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4bac22-e867-4c09-9e03-40696f47cbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4bac22-e867-4c09-9e03-40696f47cbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c8211a-6046-43e0-b342-eea92ccb438c', 'volume_name': 'volume-f3c8211a-6046-43e0-b342-eea92ccb438c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f762d7-a3f0-410a-a1c4-2952f8cf398a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f762d7-a3f0-410a-a1c4-2952f8cf398a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8cc932-ad6d-479f-9f43-258ee0eb192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:14 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Volume f3c8211a-6046-43e0-b342-eea92ccb438c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c8211a-6046-43e0-b342-eea92ccb438c', 'volume_size': 1} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:14 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 1073741824" returned: 0 in 0.845s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:14 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 Nov 06 21:24:14 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:15 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3" returned: 0 in 0.285s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1001637718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c8211a-6046-43e0-b342-eea92ccb438c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e26f71a8c141dab79011b16673f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:15Z,use_quota=True,user_id='5c0a1b441eb54a3692f5ca9c57e1cc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Creating volume f3c8211a-6046-43e0-b342-eea92ccb438c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:15 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98567689-6563-4fd6-b5a4-64fbce565d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c 1073741824 Nov 06 21:24:15 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb910357-8888-4e29-838e-8fe6d33e669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Volume volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 (99e7135e-c606-4cd7-8886-2fdbbadfd7f3): created successfully Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb910357-8888-4e29-838e-8fe6d33e669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Flow 'volume_create_manager' (a6cf8c1f-d7e9-4b0c-a6cd-e758e314c5d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:15 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a7f76fa1-21e9-42b8-b5b4-8944e1dda382 tempest-AttachVolumeNegativeTest-1471779740 None] Created volume successfully. Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:15 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Flow 'volume_create_manager' (202c99fd-f5eb-41fe-96dc-a45d4c1cb23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9983322b-49ae-49ac-aac2-74cafeabf8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c 1073741824" returned: 0 in 0.741s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9983322b-49ae-49ac-aac2-74cafeabf8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-255000215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dc094c-7121-4cee-bb2f-8b39014ae4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301bd53d4c484a59865af35f0857b963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:16Z,use_quota=True,user_id='1297f74dbc694f1ba912507a65529e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eb53bf-ded0-4760-bf07-f0b4098fae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eb53bf-ded0-4760-bf07-f0b4098fae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b03d27b-6e54-4915-a18a-9fde0cf02176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b03d27b-6e54-4915-a18a-9fde0cf02176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41dc094c-7121-4cee-bb2f-8b39014ae4fd', 'volume_name': 'volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd11370c-1b4e-4d0f-a87e-8d70a9925a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd11370c-1b4e-4d0f-a87e-8d70a9925a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1866337-ee68-484e-98cd-5a92c4cde156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:15 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Volume 41dc094c-7121-4cee-bb2f-8b39014ae4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd', 'volume_size': 1} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:15 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c Nov 06 21:24:15 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:16 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c" returned: 0 in 0.421s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-255000215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41dc094c-7121-4cee-bb2f-8b39014ae4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301bd53d4c484a59865af35f0857b963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:16Z,use_quota=True,user_id='1297f74dbc694f1ba912507a65529e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Creating volume 41dc094c-7121-4cee-bb2f-8b39014ae4fd {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:16 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:16 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd 1073741824 Nov 06 21:24:16 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8cc932-ad6d-479f-9f43-258ee0eb192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c8211a-6046-43e0-b342-eea92ccb438c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832b4f7e-a769-4e3b-b75b-94b28430d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:16 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Volume volume-f3c8211a-6046-43e0-b342-eea92ccb438c (f3c8211a-6046-43e0-b342-eea92ccb438c): created successfully Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832b4f7e-a769-4e3b-b75b-94b28430d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Flow 'volume_create_manager' (fd1369ed-3d96-42cd-af96-217c664332d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-de0354c2-2e3b-4cfc-9c7e-49184bd715b5 tempest-TestMinimumBasicScenario-2137977404 None] Created volume successfully. Nov 06 21:24:17 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd 1073741824" returned: 0 in 0.773s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-776126ce-ea1f-4507-b8ee-02aa208b1fa1 req-fc0180bf-e5ca-422d-a6a4-4cee2e6302a4 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:17 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd Nov 06 21:24:17 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Flow 'volume_create_manager' (dadd9735-6d2e-4805-b574-b7a821d23538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10baa572-210e-49bd-b9c3-cdb1325deefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:17 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10baa572-210e-49bd-b9c3-cdb1325deefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2047296409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6c9205-fad3-42dd-b48a-cfd4010a16f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d71a49252a40b0a552bfbf9401265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:17Z,use_quota=True,user_id='3d3085fdbb00438284d12b2f93db1fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24397203-db49-4b1b-b743-482b3631b4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24397203-db49-4b1b-b743-482b3631b4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7719fd0a-e477-4090-ad9d-0f954c34e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7719fd0a-e477-4090-ad9d-0f954c34e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6c9205-fad3-42dd-b48a-cfd4010a16f3', 'volume_name': 'volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad276d3-e6fb-43ad-a002-778e68649a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad276d3-e6fb-43ad-a002-778e68649a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1df2ee-c743-4060-b85a-710180f78150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:17 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Volume cb6c9205-fad3-42dd-b48a-cfd4010a16f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3', 'volume_size': 1} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd" returned: 0 in 0.424s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-776126ce-ea1f-4507-b8ee-02aa208b1fa1 req-fc0180bf-e5ca-422d-a6a4-4cee2e6302a4 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.398s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-776126ce-ea1f-4507-b8ee-02aa208b1fa1 req-fc0180bf-e5ca-422d-a6a4-4cee2e6302a4 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2047296409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6c9205-fad3-42dd-b48a-cfd4010a16f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d71a49252a40b0a552bfbf9401265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:17Z,use_quota=True,user_id='3d3085fdbb00438284d12b2f93db1fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Creating volume cb6c9205-fad3-42dd-b48a-cfd4010a16f3 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:17 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1866337-ee68-484e-98cd-5a92c4cde156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0ab8f6-cab7-499f-a817-9001fe976b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:17 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 1073741824 Nov 06 21:24:17 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:17 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Volume volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd (41dc094c-7121-4cee-bb2f-8b39014ae4fd): created successfully Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0ab8f6-cab7-499f-a817-9001fe976b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Flow 'volume_create_manager' (202c99fd-f5eb-41fe-96dc-a45d4c1cb23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:17 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bb2f9e0d-4d97-4c53-817e-3c6e475f9c33 tempest-VolumesTransfersV357Test-393901135 None] Created volume successfully. Nov 06 21:24:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-776126ce-ea1f-4507-b8ee-02aa208b1fa1 req-fc0180bf-e5ca-422d-a6a4-4cee2e6302a4 tempest-AttachVolumeNegativeTest-1471779740 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3129d449-bd16-46ec-93eb-d70a676f2b3f', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:24:17 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-776126ce-ea1f-4507-b8ee-02aa208b1fa1 req-fc0180bf-e5ca-422d-a6a4-4cee2e6302a4 tempest-AttachVolumeNegativeTest-1471779740 None] attachment_update completed successfully. Nov 06 21:24:18 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 1073741824" returned: 0 in 0.774s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d4865ee5-d688-4542-babc-d97e794001a7 req-f15ba98d-718c-478b-9462-3b388fc3608a tempest-TestMinimumBasicScenario-2137977404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:18 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 Nov 06 21:24:18 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:18 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3" returned: 0 in 0.318s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d4865ee5-d688-4542-babc-d97e794001a7 req-f15ba98d-718c-478b-9462-3b388fc3608a tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.367s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d4865ee5-d688-4542-babc-d97e794001a7 req-f15ba98d-718c-478b-9462-3b388fc3608a tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1df2ee-c743-4060-b85a-710180f78150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee54586-cef8-4be8-802a-24d2f8ca2010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-d4865ee5-d688-4542-babc-d97e794001a7 req-f15ba98d-718c-478b-9462-3b388fc3608a tempest-TestMinimumBasicScenario-2137977404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-f3c8211a-6046-43e0-b342-eea92ccb438c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82534003-c20e-4336-81b0-84e3e936922d', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:24:18 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Volume volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 (cb6c9205-fad3-42dd-b48a-cfd4010a16f3): created successfully Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee54586-cef8-4be8-802a-24d2f8ca2010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Flow 'volume_create_manager' (dadd9735-6d2e-4805-b574-b7a821d23538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:18 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ee1aad9d-93a3-44b6-b302-98d6218622b5 tempest-VolumesTransfersTest-941424519 None] Created volume successfully. Nov 06 21:24:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-d4865ee5-d688-4542-babc-d97e794001a7 req-f15ba98d-718c-478b-9462-3b388fc3608a tempest-TestMinimumBasicScenario-2137977404 None] attachment_update completed successfully. Nov 06 21:24:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f758c3af-a957-4933-bc98-9224fedb907b tempest-VolumesTransfersV357Test-633341965 None] Transfer volume completed successfully. Nov 06 21:24:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Acquiring lock "cinder-41dc094c-7121-4cee-bb2f-8b39014ae4fd-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-41dc094c-7121-4cee-bb2f-8b39014ae4fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Acquiring lock "cinder-quobyte-41dc094c-7121-4cee-bb2f-8b39014ae4fd" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-quobyte-41dc094c-7121-4cee-bb2f-8b39014ae4fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe7680-1269-4c59-bd80-8aba746f2376]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:20 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd Nov 06 21:24:20 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:20 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd" returned: 0 in 0.449s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:20 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd Nov 06 21:24:20 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:20 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-dc788bdb-c163-4d90-8743-40a858a97057 tempest-VolumesTransfersTest-1426610551 None] Transfer volume completed successfully. Nov 06 21:24:20 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-41dc094c-7121-4cee-bb2f-8b39014ae4fd" returned: 0 in 0.381s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-quobyte-41dc094c-7121-4cee-bb2f-8b39014ae4fd" released by "delete_volume" :: held 0.890s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Created reservations ['71a915ee-0226-486a-92ce-e4da5b7402c7', '6c86f84f-0765-4042-ad9e-e340632b6ef4', '0a6c34f7-348f-4112-b274-131c6db7e4dd', '0624ca45-e2e2-4a1d-a895-3656c6c57054'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:21 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:21 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:21 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.503s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Deleted volume successfully. Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bab850c4-b44e-461e-8f2e-6c9e9fd6f1ab tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-41dc094c-7121-4cee-bb2f-8b39014ae4fd-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Acquiring lock "cinder-cb6c9205-fad3-42dd-b48a-cfd4010a16f3-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-cb6c9205-fad3-42dd-b48a-cfd4010a16f3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Acquiring lock "cinder-quobyte-cb6c9205-fad3-42dd-b48a-cfd4010a16f3" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-quobyte-cb6c9205-fad3-42dd-b48a-cfd4010a16f3" acquired by "delete_volume" :: waited 0.049s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e1e2b-67e2-4ee3-959e-36fb4bb489df]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Flow 'volume_create_manager' (808f794a-c140-4111-a08e-9773194d4a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:22 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 Nov 06 21:24:22 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544ce6ee-aaaf-4503-86b6-6c4447af6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544ce6ee-aaaf-4503-86b6-6c4447af6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-96018928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b7531c-292f-456a-ac46-784a33ae3d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301bd53d4c484a59865af35f0857b963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:22Z,use_quota=True,user_id='1297f74dbc694f1ba912507a65529e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58baa073-0ae9-42b7-b146-479cbcbfc642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58baa073-0ae9-42b7-b146-479cbcbfc642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb71dee-02ff-468c-99e9-ab52868297ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb71dee-02ff-468c-99e9-ab52868297ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b7531c-292f-456a-ac46-784a33ae3d0f', 'volume_name': 'volume-34b7531c-292f-456a-ac46-784a33ae3d0f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7096fa-21a3-4288-a9ed-38083a24930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7096fa-21a3-4288-a9ed-38083a24930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34529c0f-3065-4a18-9249-f8c9d04fd027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:22 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Volume 34b7531c-292f-456a-ac46-784a33ae3d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b7531c-292f-456a-ac46-784a33ae3d0f', 'volume_size': 1} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-96018928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b7531c-292f-456a-ac46-784a33ae3d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301bd53d4c484a59865af35f0857b963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:22Z,use_quota=True,user_id='1297f74dbc694f1ba912507a65529e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Creating volume 34b7531c-292f-456a-ac46-784a33ae3d0f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:22 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-7272bc75-9f18-4faf-bd34-1f18a9eed23f req-75e2eee1-f8c2-499e-8fe5-1db644800ae4 tempest-AttachVolumeNegativeTest-1471779740 None] Terminate volume connection completed successfully. Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-7272bc75-9f18-4faf-bd34-1f18a9eed23f req-75e2eee1-f8c2-499e-8fe5-1db644800ae4 tempest-AttachVolumeNegativeTest-1471779740 None] Deleting attachment 3129d449-bd16-46ec-93eb-d70a676f2b3f. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:24:22 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f 1073741824 Nov 06 21:24:22 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:22 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3" returned: 0 in 0.746s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:22 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3 Nov 06 21:24:22 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:23 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:23 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cb6c9205-fad3-42dd-b48a-cfd4010a16f3" returned: 0 in 0.361s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f 1073741824" returned: 0 in 0.769s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-quobyte-cb6c9205-fad3-42dd-b48a-cfd4010a16f3" released by "delete_volume" :: held 1.244s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Created reservations ['4f2e8753-40be-4183-97df-c322171f70be', 'af561b33-0f3d-4bba-b716-c7330eff0468', 'f012a676-055b-4ee3-b138-a883e8f85d2a', 'c0e2fd4c-b1c3-46ca-8b59-5d1eb8d4fa58'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:23 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f Nov 06 21:24:23 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:23 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:23 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:23 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f" returned: 0 in 0.367s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34529c0f-3065-4a18-9249-f8c9d04fd027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b7531c-292f-456a-ac46-784a33ae3d0f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3a1ca-2208-48eb-bd5c-33822605281d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:23 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Volume volume-34b7531c-292f-456a-ac46-784a33ae3d0f (34b7531c-292f-456a-ac46-784a33ae3d0f): created successfully Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3a1ca-2208-48eb-bd5c-33822605281d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Flow 'volume_create_manager' (808f794a-c140-4111-a08e-9773194d4a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:23 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-17d2ee82-bc06-4e03-9776-49eae6bd6eec tempest-VolumesTransfersV357Test-393901135 None] Created volume successfully. Nov 06 21:24:23 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.428s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:23 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Deleted volume successfully. Nov 06 21:24:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a4ed98d3-34da-46cc-8260-f20247469913 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-cb6c9205-fad3-42dd-b48a-cfd4010a16f3-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Acquiring lock "cinder-34b7531c-292f-456a-ac46-784a33ae3d0f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-34b7531c-292f-456a-ac46-784a33ae3d0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Acquiring lock "cinder-quobyte-34b7531c-292f-456a-ac46-784a33ae3d0f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-quobyte-34b7531c-292f-456a-ac46-784a33ae3d0f" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b554c4c2-9abc-4b95-a05f-cdba1e0db95b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:25 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f Nov 06 21:24:25 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Flow 'volume_create_manager' (8dfed0b2-fd1b-441f-ba82-e4162fa45e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe189c00-f7d4-4234-b0ba-1bf4cb44b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe189c00-f7d4-4234-b0ba-1bf4cb44b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334528317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a42ad1-1e13-4157-b8e4-d6505da6c895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d71a49252a40b0a552bfbf9401265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:26Z,use_quota=True,user_id='3d3085fdbb00438284d12b2f93db1fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d407ebe2-d0e0-4d7e-a18c-31c3aa2f128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d407ebe2-d0e0-4d7e-a18c-31c3aa2f128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d619d09-5d2a-4c43-a91d-1b460ff9aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d619d09-5d2a-4c43-a91d-1b460ff9aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a42ad1-1e13-4157-b8e4-d6505da6c895', 'volume_name': 'volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d8212a-19a8-464b-842a-c9425b0dd48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d8212a-19a8-464b-842a-c9425b0dd48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3dce2-f8ce-4710-933f-582f46b92616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:25 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Volume e3a42ad1-1e13-4157-b8e4-d6505da6c895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895', 'volume_size': 1} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-334528317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a42ad1-1e13-4157-b8e4-d6505da6c895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d71a49252a40b0a552bfbf9401265e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:26Z,use_quota=True,user_id='3d3085fdbb00438284d12b2f93db1fdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Creating volume e3a42ad1-1e13-4157-b8e4-d6505da6c895 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:25 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:25 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 1073741824 Nov 06 21:24:25 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:26 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f" returned: 0 in 0.811s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:26 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f Nov 06 21:24:26 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:26 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-34b7531c-292f-456a-ac46-784a33ae3d0f" returned: 0 in 0.497s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-quobyte-34b7531c-292f-456a-ac46-784a33ae3d0f" released by "delete_volume" :: held 1.431s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:26 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 1073741824" returned: 0 in 0.776s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Created reservations ['98f74398-bbd7-433c-a0f4-21d4d3da4cfb', '1d774f6e-964f-4619-a422-6c337782120e', 'fe62880c-34b9-4c50-b76b-2683cc86bbb0', '39f826b3-b8f6-4961-ae9e-b7a091a880d4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:26 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 Nov 06 21:24:26 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:27 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:27 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:27 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895" returned: 0 in 0.425s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e3dce2-f8ce-4710-933f-582f46b92616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8352de63-da3c-4928-8421-1192c1049383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Volume volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 (e3a42ad1-1e13-4157-b8e4-d6505da6c895): created successfully Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8352de63-da3c-4928-8421-1192c1049383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Flow 'volume_create_manager' (8dfed0b2-fd1b-441f-ba82-e4162fa45e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-24eace6c-dbc8-45b1-b303-4dac8a75b9db tempest-VolumesTransfersTest-941424519 None] Created volume successfully. Nov 06 21:24:27 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.466s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Deleted volume successfully. Nov 06 21:24:27 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fec2c682-54cb-4313-8f9a-81850eb5f6ca tempest-VolumesTransfersV357Test-1697334220 None] Lock "cinder-34b7531c-292f-456a-ac46-784a33ae3d0f-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Acquiring lock "cinder-e3a42ad1-1e13-4157-b8e4-d6505da6c895-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-e3a42ad1-1e13-4157-b8e4-d6505da6c895-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Acquiring lock "cinder-quobyte-e3a42ad1-1e13-4157-b8e4-d6505da6c895" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-quobyte-e3a42ad1-1e13-4157-b8e4-d6505da6c895" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b401e-8bc6-4422-8cb5-032d14e4de61]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:28 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 Nov 06 21:24:28 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:28 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895" returned: 0 in 0.526s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:28 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895 Nov 06 21:24:28 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:29 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e3a42ad1-1e13-4157-b8e4-d6505da6c895" returned: 0 in 0.449s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-quobyte-e3a42ad1-1e13-4157-b8e4-d6505da6c895" released by "delete_volume" :: held 1.050s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Created reservations ['759a349f-bc40-4f83-97e7-4b8c40ed1600', '0eaf56ab-5adb-434e-a693-b9ba7bb10677', '7b57419f-6d48-4755-b01e-e2b84ce0c865', '8d789928-15e4-4b4a-9b22-541e346de338'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:29 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:29 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "cinder-99e7135e-c606-4cd7-8886-2fdbbadfd7f3-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-99e7135e-c606-4cd7-8886-2fdbbadfd7f3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "cinder-quobyte-99e7135e-c606-4cd7-8886-2fdbbadfd7f3" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-quobyte-99e7135e-c606-4cd7-8886-2fdbbadfd7f3" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6584bb-9347-442d-b34b-c7ab3d95904d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:29 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Deleted volume successfully. Nov 06 21:24:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c5044d55-f30d-4c3a-b3c7-923d8dd2bbe5 tempest-VolumesTransfersTest-335182142 None] Lock "cinder-e3a42ad1-1e13-4157-b8e4-d6505da6c895-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:30 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 Nov 06 21:24:30 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:30 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3" returned: 0 in 0.420s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:30 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3 Nov 06 21:24:30 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:30 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-99e7135e-c606-4cd7-8886-2fdbbadfd7f3" returned: 0 in 0.317s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-quobyte-99e7135e-c606-4cd7-8886-2fdbbadfd7f3" released by "delete_volume" :: held 0.817s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Created reservations ['1fd36b77-d4fc-4bef-988f-8ad0fa832dd4', '6e6ac618-a011-4d94-934a-cc9d79af914c', 'fb20011f-bd18-4ed7-846c-2507b1ab7fda', 'fa87ef5d-9477-4428-937d-d086e36ef208'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:30 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:30 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "cinder-5310471a-c6ec-46be-9974-6f3eaf9d83e9-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-5310471a-c6ec-46be-9974-6f3eaf9d83e9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:31 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.403s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Deleted volume successfully. Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "cinder-quobyte-5310471a-c6ec-46be-9974-6f3eaf9d83e9" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e7ebacf9-b0f0-425a-b1d7-3dd325c11db5 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-99e7135e-c606-4cd7-8886-2fdbbadfd7f3-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-quobyte-5310471a-c6ec-46be-9974-6f3eaf9d83e9" acquired by "delete_volume" :: waited 0.046s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8739a8-54bf-47d5-83c3-3b898bbc5349]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:31 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 Nov 06 21:24:31 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:31 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9" returned: 0 in 0.494s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:31 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9 Nov 06 21:24:31 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:32 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:32 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:32 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5310471a-c6ec-46be-9974-6f3eaf9d83e9" returned: 0 in 0.525s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-quobyte-5310471a-c6ec-46be-9974-6f3eaf9d83e9" released by "delete_volume" :: held 1.112s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:32 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.386s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 28 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Created reservations ['52647620-4e3d-4aea-b445-e2194a18ce26', '4688786f-f62e-49b1-af72-7bb7307a41a6', '2cc07cb1-8352-4d8c-a627-3d1d846a63be', '02dbf392-d5e2-4cc4-9ebb-f28ce87317b4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:32 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:32 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:33 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.319s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Deleted volume successfully. Nov 06 21:24:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-117184b0-436e-4298-bbe6-259c2a857d34 tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-5310471a-c6ec-46be-9974-6f3eaf9d83e9-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "cinder-a2f0ebd9-21af-4687-87ff-bb6c4f33479b-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-a2f0ebd9-21af-4687-87ff-bb6c4f33479b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "cinder-quobyte-a2f0ebd9-21af-4687-87ff-bb6c4f33479b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-quobyte-a2f0ebd9-21af-4687-87ff-bb6c4f33479b" acquired by "delete_volume" :: waited 0.043s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b343c313-fcc8-453d-a2e6-19b11ff5534e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:34 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b Nov 06 21:24:34 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:34 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b" returned: 0 in 0.462s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:34 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b Nov 06 21:24:34 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:34 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2f0ebd9-21af-4687-87ff-bb6c4f33479b" returned: 0 in 0.330s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-quobyte-a2f0ebd9-21af-4687-87ff-bb6c4f33479b" released by "delete_volume" :: held 0.871s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Created reservations ['8920d7fc-73c4-4ea0-9ea6-d16f086764ea', '73351b52-22af-4d2f-b399-0ab8d4967867', 'ded5e48c-2bf8-4e67-ab39-45dc6bb8f893', '650edf87-5163-488b-b483-d97d10ac00f9'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:35 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:35 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:35 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.372s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Deleted volume successfully. Nov 06 21:24:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1dc5a3e7-bcf6-4f41-abdd-d524fe92bbcd tempest-AttachVolumeNegativeTest-1471779740 None] Lock "cinder-a2f0ebd9-21af-4687-87ff-bb6c4f33479b-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (d2c690e8-a6ed-464e-965e-2f1832646388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcadf24-a7b6-421c-a80f-c0b5cc32a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcadf24-a7b6-421c-a80f-c0b5cc32a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1143636037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e30f81-59ee-43e0-a7c3-eb99d6f5edbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:37Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dded1dd-637d-4ad3-bbdb-8b6a30d7bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dded1dd-637d-4ad3-bbdb-8b6a30d7bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e113eef-2fc8-4850-afa9-b3ba7c8e9bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e113eef-2fc8-4850-afa9-b3ba7c8e9bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e30f81-59ee-43e0-a7c3-eb99d6f5edbd', 'volume_name': 'volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8acb2fb-6592-4eb6-8085-e38d1beb77ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8acb2fb-6592-4eb6-8085-e38d1beb77ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f247c07c-741c-49cf-97b4-5a24a9cca17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Volume 28e30f81-59ee-43e0-a7c3-eb99d6f5edbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd', 'volume_size': 1} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1143636037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e30f81-59ee-43e0-a7c3-eb99d6f5edbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:37Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Creating volume 28e30f81-59ee-43e0-a7c3-eb99d6f5edbd {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:37 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:37 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd 1073741824 Nov 06 21:24:37 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:37 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd 1073741824" returned: 0 in 0.656s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:38 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd Nov 06 21:24:38 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:38 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd" returned: 0 in 0.273s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f247c07c-741c-49cf-97b4-5a24a9cca17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbdfc7db-29dc-466b-a27c-884312643a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Volume volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd (28e30f81-59ee-43e0-a7c3-eb99d6f5edbd): created successfully Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbdfc7db-29dc-466b-a27c-884312643a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (d2c690e8-a6ed-464e-965e-2f1832646388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2377800f-a29d-4022-8174-fd191848261b tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (80e03beb-8c26-456c-b877-f4401c377287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7b55f8-01f2-4915-80f9-b49f1bff3177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7b55f8-01f2-4915-80f9-b49f1bff3177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-315204320',display_name='tempest-VolumesGetTest-Volume-554625172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab90d130-3b26-45d4-ba5b-8575c27b99fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:40Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf699c08-fcab-4ed4-b719-2056aee4e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf699c08-fcab-4ed4-b719-2056aee4e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7948846-d996-4b32-8003-27b70fe115cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7948846-d996-4b32-8003-27b70fe115cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab90d130-3b26-45d4-ba5b-8575c27b99fb', 'volume_name': 'volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c467525-b8ce-4531-8293-b8e4f1dcee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c467525-b8ce-4531-8293-b8e4f1dcee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6196dfb6-5e7f-4742-ae02-d809027d80f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:40 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Volume ab90d130-3b26-45d4-ba5b-8575c27b99fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb', 'volume_size': 1} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-315204320',display_name='tempest-VolumesGetTest-Volume-554625172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab90d130-3b26-45d4-ba5b-8575c27b99fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:40Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Creating volume ab90d130-3b26-45d4-ba5b-8575c27b99fb {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:40 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:40 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb 1073741824 Nov 06 21:24:40 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:41 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb 1073741824" returned: 0 in 0.600s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:41 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb Nov 06 21:24:41 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:41 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb" returned: 0 in 0.346s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6196dfb6-5e7f-4742-ae02-d809027d80f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba57eaf3-acd3-4fdf-acb3-552c361bb730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Volume volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb (ab90d130-3b26-45d4-ba5b-8575c27b99fb): created successfully Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba57eaf3-acd3-4fdf-acb3-552c361bb730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (80e03beb-8c26-456c-b877-f4401c377287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5a5a349e-f576-4850-aef6-4685d0bfb36e tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-ab90d130-3b26-45d4-ba5b-8575c27b99fb-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Lock "cinder-ab90d130-3b26-45d4-ba5b-8575c27b99fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-ab90d130-3b26-45d4-ba5b-8575c27b99fb" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-ab90d130-3b26-45d4-ba5b-8575c27b99fb" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c94b832-37b1-4dc1-b8c3-231f4fc3129a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:43 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb Nov 06 21:24:43 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:43 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb" returned: 0 in 0.576s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:43 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb Nov 06 21:24:43 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:44 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab90d130-3b26-45d4-ba5b-8575c27b99fb" returned: 0 in 0.323s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-ab90d130-3b26-45d4-ba5b-8575c27b99fb" released by "delete_volume" :: held 0.996s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Created reservations ['de332984-46c5-402a-b692-24b5f2f682e6', '57539611-82ff-4b46-962e-b6d1094ca28c', '8f1dc9ce-0d0b-4ff7-a5ad-0f6e73e40ad8', '997b4826-6f1b-4845-aaee-d7446c67fa01'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:44 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:44 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:44 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.302s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:24:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fab79731-ee26-47fa-aa95-731836ec4fcd tempest-VolumesGetTest-801405821 None] Lock "cinder-ab90d130-3b26-45d4-ba5b-8575c27b99fb-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Lock "cinder-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ceea95-2104-4701-9ea9-09abb440fb7c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Flow 'volume_create_manager' (d4fc9e5e-87f0-4f9f-8446-76e0776d7018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8005b14b-fa70-49ad-a1a9-3a32ee5751d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8005b14b-fa70-49ad-a1a9-3a32ee5751d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1454824373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e12833f-fe77-4cce-87d3-2857761fa34b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c648f6e70754fd7bcedcbe0954cf97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:46Z,use_quota=True,user_id='6721fc5b04f04cbdbb9b8f81749687cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e90288-982f-4580-8568-4d9f9841d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e90288-982f-4580-8568-4d9f9841d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:45 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd Nov 06 21:24:45 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74448a7e-56e5-47ad-aa4a-207a0ca909ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74448a7e-56e5-47ad-aa4a-207a0ca909ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e12833f-fe77-4cce-87d3-2857761fa34b', 'volume_name': 'volume-7e12833f-fe77-4cce-87d3-2857761fa34b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12167878-4207-4928-b322-2b4f7dbe8548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12167878-4207-4928-b322-2b4f7dbe8548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e953f59-b1e7-4e0f-beba-7c473933db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:46 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Volume 7e12833f-fe77-4cce-87d3-2857761fa34b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e12833f-fe77-4cce-87d3-2857761fa34b', 'volume_size': 1} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1454824373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e12833f-fe77-4cce-87d3-2857761fa34b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c648f6e70754fd7bcedcbe0954cf97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:46Z,use_quota=True,user_id='6721fc5b04f04cbdbb9b8f81749687cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Creating volume 7e12833f-fe77-4cce-87d3-2857761fa34b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:46 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:46 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b 1073741824 Nov 06 21:24:46 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd" returned: 0 in 0.615s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:46 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd Nov 06 21:24:46 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:46 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b 1073741824" returned: 0 in 0.773s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd" returned: 0 in 0.406s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd" released by "delete_volume" :: held 1.102s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:46 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b Nov 06 21:24:46 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Created reservations ['7fd60c76-ac02-4464-a397-a3b3a1345881', '18f67eeb-5a44-4b76-b8ad-01505bbb6bf2', '651d31ea-7a89-4ef5-a3b1-cee2957087e8', 'baea9e24-dd48-4ffa-a14e-e83fe9d5ec8f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:47 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:24:47 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:47 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b" returned: 0 in 0.444s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e953f59-b1e7-4e0f-beba-7c473933db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e12833f-fe77-4cce-87d3-2857761fa34b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:47 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71933248-2ee4-4295-97a8-672252fcf3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.356s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:24:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:24:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Volume volume-7e12833f-fe77-4cce-87d3-2857761fa34b (7e12833f-fe77-4cce-87d3-2857761fa34b): created successfully Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71933248-2ee4-4295-97a8-672252fcf3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Flow 'volume_create_manager' (d4fc9e5e-87f0-4f9f-8446-76e0776d7018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a2ebb805-3b77-4e42-80d9-96b5f017af7f tempest-VolumesTestJSON-1916617303 None] Created volume successfully. Nov 06 21:24:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5af0ce21-e558-41e8-a081-79dd1f452a7e tempest-VolumesGetTest-801405821 None] Lock "cinder-28e30f81-59ee-43e0-a7c3-eb99d6f5edbd-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (c32e21b6-6ea4-43f8-8bb9-a429e51b1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66159da9-12e5-4f50-816a-f1ad18c7268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66159da9-12e5-4f50-816a-f1ad18c7268e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859296833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0eeb0f-0896-4433-8532-5cc07b914798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:49Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7736f7d-6948-4390-8aec-152c13fd7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7736f7d-6948-4390-8aec-152c13fd7c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc76ecf-df3b-46cd-8f32-ed2b2fc15e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc76ecf-df3b-46cd-8f32-ed2b2fc15e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0eeb0f-0896-4433-8532-5cc07b914798', 'volume_name': 'volume-ad0eeb0f-0896-4433-8532-5cc07b914798', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cea9e5-1445-43e9-8677-14a0321023cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cea9e5-1445-43e9-8677-14a0321023cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb01e38-54c3-47f7-9761-8588cba32f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Volume ad0eeb0f-0896-4433-8532-5cc07b914798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0eeb0f-0896-4433-8532-5cc07b914798', 'volume_size': 1} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859296833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0eeb0f-0896-4433-8532-5cc07b914798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:49Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Creating volume ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:49 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:49 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 1073741824 Nov 06 21:24:49 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Flow 'volume_create_manager' (e573f33e-ea67-4e46-be9e-f5cd0fa63b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc8a009-15fb-4e4b-a90b-cbd28f55adc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc8a009-15fb-4e4b-a90b-cbd28f55adc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379604300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bbf56e-f273-4820-b0b5-6596c156c780,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c648f6e70754fd7bcedcbe0954cf97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:49Z,use_quota=True,user_id='6721fc5b04f04cbdbb9b8f81749687cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52451286-7b84-4299-8142-5eff89de0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52451286-7b84-4299-8142-5eff89de0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4070ac-7414-45bc-a18c-79311b2b017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4070ac-7414-45bc-a18c-79311b2b017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bbf56e-f273-4820-b0b5-6596c156c780', 'volume_name': 'volume-d4bbf56e-f273-4820-b0b5-6596c156c780', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e54d216-7506-431a-a391-747383054f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e54d216-7506-431a-a391-747383054f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1841e9c-7fc6-4aab-b8e1-68db59800f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Volume d4bbf56e-f273-4820-b0b5-6596c156c780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bbf56e-f273-4820-b0b5-6596c156c780', 'volume_size': 1} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:49 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 1073741824" returned: 0 in 0.581s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:49 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 Nov 06 21:24:49 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:50 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798" returned: 0 in 0.336s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379604300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bbf56e-f273-4820-b0b5-6596c156c780,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c648f6e70754fd7bcedcbe0954cf97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:49Z,use_quota=True,user_id='6721fc5b04f04cbdbb9b8f81749687cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Creating volume d4bbf56e-f273-4820-b0b5-6596c156c780 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:24:50 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb01e38-54c3-47f7-9761-8588cba32f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0eeb0f-0896-4433-8532-5cc07b914798', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:50 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 1073741824 Nov 06 21:24:50 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b0f3a-f7c1-4b5b-859c-60ce8408e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Volume volume-ad0eeb0f-0896-4433-8532-5cc07b914798 (ad0eeb0f-0896-4433-8532-5cc07b914798): created successfully Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b0f3a-f7c1-4b5b-859c-60ce8408e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (c32e21b6-6ea4-43f8-8bb9-a429e51b1178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f0ab855e-6458-40d2-92f8-8d90c08cddb5 tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:24:50 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 1073741824" returned: 0 in 0.591s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:51 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 Nov 06 21:24:51 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:51 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780" returned: 0 in 0.496s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1841e9c-7fc6-4aab-b8e1-68db59800f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bbf56e-f273-4820-b0b5-6596c156c780', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b89be4-cbc7-43ef-8e1c-61c87060bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:51 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Volume volume-d4bbf56e-f273-4820-b0b5-6596c156c780 (d4bbf56e-f273-4820-b0b5-6596c156c780): created successfully Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b89be4-cbc7-43ef-8e1c-61c87060bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Flow 'volume_create_manager' (e573f33e-ea67-4e46-be9e-f5cd0fa63b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:51 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-307c0a64-1cc2-4f22-8434-e6e4a8ea6d28 tempest-VolumesTestJSON-1916617303 None] Created volume successfully. Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (d018bf56-cf53-45bc-98cf-37657499ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce366195-ccb6-4a58-9626-2b98e0325d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce366195-ccb6-4a58-9626-2b98e0325d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-212040530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4c5c26-8192-419b-b135-3434f4a504dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ad0eeb0f-0896-4433-8532-5cc07b914798,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:52Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61491c2f-19b2-4873-8086-90d84d302916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61491c2f-19b2-4873-8086-90d84d302916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8dd76b-6975-4fcb-9cf5-172da3b0f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8dd76b-6975-4fcb-9cf5-172da3b0f216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'df4c5c26-8192-419b-b135-3434f4a504dc', 'volume_name': 'volume-df4c5c26-8192-419b-b135-3434f4a504dc', 'volume_size': 1, 'source_volid': 'ad0eeb0f-0896-4433-8532-5cc07b914798', 'source_volstatus': 'available'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a576e0-5ed1-48c9-86cb-581874b28b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a576e0-5ed1-48c9-86cb-581874b28b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8564811b-de5c-4f05-a1ef-7470c31f8430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:51 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Volume df4c5c26-8192-419b-b135-3434f4a504dc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-df4c5c26-8192-419b-b135-3434f4a504dc', 'volume_size': 1, 'source_volid': 'ad0eeb0f-0896-4433-8532-5cc07b914798', 'source_volstatus': 'available'} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:51 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Cloning volume ad0eeb0f-0896-4433-8532-5cc07b914798 to volume df4c5c26-8192-419b-b135-3434f4a504dc Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Creating offline snapshot f001f625-fd4b-43ce-8be9-734cfccc83f6 of volume ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba820f4-a436-4bf0-a061-b8dcc2c9da38]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:52 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 Nov 06 21:24:52 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:52 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798" returned: 0 in 0.519s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:52 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 1G Nov 06 21:24:52 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (33618021-640f-48f6-8f0b-40b58c7b738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a066f053-d59f-4f5b-8d18-503970fe8c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a066f053-d59f-4f5b-8d18-503970fe8c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-325040569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bcad39-7c60-4864-ae7c-b244a4fa1bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:53Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90750cf3-0696-4a3e-b567-f7dd024756be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90750cf3-0696-4a3e-b567-f7dd024756be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda9c18f-eec2-497e-860e-21392a102ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda9c18f-eec2-497e-860e-21392a102ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12bcad39-7c60-4864-ae7c-b244a4fa1bf8', 'volume_name': 'volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce37fa81-25ca-494d-bbc4-000d92bcf951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce37fa81-25ca-494d-bbc4-000d92bcf951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9664fd2e-4440-4cf4-a21c-499bc83b88dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Volume 12bcad39-7c60-4864-ae7c-b244a4fa1bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8', 'volume_size': 1} Nov 06 21:24:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Flow 'volume_create_manager' (70beb84e-b6cf-4e0c-a195-bd02c3052d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512463e0-4322-46c1-b23b-8a3fed2e52b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512463e0-4322-46c1-b23b-8a3fed2e52b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-431398667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222912ec-045d-4ff3-9520-d95c564428d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c648f6e70754fd7bcedcbe0954cf97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:53Z,use_quota=True,user_id='6721fc5b04f04cbdbb9b8f81749687cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e470550-50dd-4516-9ded-34b0f5932aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e470550-50dd-4516-9ded-34b0f5932aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c74bb11-776c-4c06-8d80-da7f4e0d55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c74bb11-776c-4c06-8d80-da7f4e0d55d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222912ec-045d-4ff3-9520-d95c564428d0', 'volume_name': 'volume-222912ec-045d-4ff3-9520-d95c564428d0', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffff8f3a-c576-4b39-a0ef-8bb0139ca2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffff8f3a-c576-4b39-a0ef-8bb0139ca2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce2d4d8-e6a8-4fcc-a7d4-0750911e5344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:24:53 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Volume 222912ec-045d-4ff3-9520-d95c564428d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222912ec-045d-4ff3-9520-d95c564428d0', 'volume_size': 1} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 1G" returned: 0 in 0.583s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0eeb0f-0896-4433-8532-5cc07b914798 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:53 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0eeb0f-0896-4433-8532-5cc07b914798 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 Nov 06 21:24:53 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:53 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad0eeb0f-0896-4433-8532-5cc07b914798 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:53 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 is being set with open permissions: ugo+rw Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:53 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 Nov 06 21:24:53 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:53 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6" returned: 0 in 0.278s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:53 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info Nov 06 21:24:53 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:53 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info" returned: 0 in 0.262s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:54 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info is being set with open permissions: ugo+rw Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:54 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info Nov 06 21:24:54 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:54 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.info" returned: 0 in 0.266s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-df4c5c26-8192-419b-b135-3434f4a504dc" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-df4c5c26-8192-419b-b135-3434f4a504dc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] snapshot: f001f625-fd4b-43ce-8be9-734cfccc83f6, volume: df4c5c26-8192-419b-b135-3434f4a504dc, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[676c5db2-7de6-4fc6-9699-7b68b6e9b602]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:54 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 Nov 06 21:24:54 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:54 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad0eeb0f-0896-4433-8532-5cc07b914798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f56d26c-bf9f-4504-b7a3-887fcdd8656b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:24:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:54 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 Nov 06 21:24:54 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:24:55 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 06 21:24:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798" returned: 0 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:24:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:24:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:24:55 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:24:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:24:55 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc Nov 06 21:24:55 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:00 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc" returned: 0 in 5.719s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:00 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:25:00 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Converted 1024.00 MB image at 179.01 MB/s Nov 06 21:25:00 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc is being set with open permissions: ugo+rw Nov 06 21:25:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:00 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc Nov 06 21:25:00 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:01 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc" returned: 0 in 0.240s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-df4c5c26-8192-419b-b135-3434f4a504dc" released by "_copy_volume_from_snapshot" :: held 6.797s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-f001f625-fd4b-43ce-8be9-734cfccc83f6" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-f001f625-fd4b-43ce-8be9-734cfccc83f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Deleting offline snapshot f001f625-fd4b-43ce-8be9-734cfccc83f6 of volume ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] snapshot_file for this snap is: volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb19416-bf67-4aa9-8f46-838e79f58d16]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:01 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 Nov 06 21:25:01 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:01 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6" returned: 0 in 0.427s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad0eeb0f-0896-4433-8532-5cc07b914798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[443774bc-727d-4e29-9b18-706f6cf1de25]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:01 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 Nov 06 21:25:01 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:02 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798" returned: 0 in 0.542s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:02 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 Nov 06 21:25:02 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:02 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6" returned: 0 in 0.361s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:02 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6 Nov 06 21:25:02 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:02 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798.f001f625-fd4b-43ce-8be9-734cfccc83f6" returned: 0 in 0.249s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-f001f625-fd4b-43ce-8be9-734cfccc83f6" released by "_delete_snapshot" :: held 1.693s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.887s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.049s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-325040569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bcad39-7c60-4864-ae7c-b244a4fa1bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:53Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Creating volume 12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:02 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8564811b-de5c-4f05-a1ef-7470c31f8430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4c5c26-8192-419b-b135-3434f4a504dc', 'volume_size': 1, 'source_volid': 'ad0eeb0f-0896-4433-8532-5cc07b914798', 'source_volstatus': 'available'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 1073741824 Nov 06 21:25:02 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71228e83-9f42-430f-a739-5a7c31ac1ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Volume volume-df4c5c26-8192-419b-b135-3434f4a504dc (df4c5c26-8192-419b-b135-3434f4a504dc): created successfully Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71228e83-9f42-430f-a739-5a7c31ac1ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (d018bf56-cf53-45bc-98cf-37657499ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-aada791c-fc49-475c-97e7-00c86ace8c22 tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:25:03 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 1073741824" returned: 0 in 0.493s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:03 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 Nov 06 21:25:03 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:03 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.557s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-431398667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222912ec-045d-4ff3-9520-d95c564428d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c648f6e70754fd7bcedcbe0954cf97a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:24:53Z,use_quota=True,user_id='6721fc5b04f04cbdbb9b8f81749687cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Creating volume 222912ec-045d-4ff3-9520-d95c564428d0 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:03 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:03 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 1073741824 Nov 06 21:25:03 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9664fd2e-4440-4cf4-a21c-499bc83b88dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6456f4-4a4f-4fb2-ac6d-474893c6bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Volume volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 (12bcad39-7c60-4864-ae7c-b244a4fa1bf8): created successfully Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6456f4-4a4f-4fb2-ac6d-474893c6bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (33618021-640f-48f6-8f0b-40b58c7b738d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-712c3997-128b-45f7-8c5a-5639ab38294a tempest-VolumesSnapshotTestJSON-938610065 None] Created volume successfully. Nov 06 21:25:04 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 1073741824" returned: 0 in 0.630s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:04 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 Nov 06 21:25:04 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (76d085fc-fb41-4671-b4ac-14abfec7a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb0ea6e-2afb-42ae-8665-0926c3b71dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb0ea6e-2afb-42ae-8665-0926c3b71dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2061003726',display_name='tempest-VolumesGetTest-Volume-1119971720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8558c7b-f675-46e1-bb92-2a4de4c12fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:05Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a42cd2-432d-493a-b4d3-a4c1c81028c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a42cd2-432d-493a-b4d3-a4c1c81028c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2676dc-0289-4b7a-a8ac-eb340f1edccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2676dc-0289-4b7a-a8ac-eb340f1edccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8558c7b-f675-46e1-bb92-2a4de4c12fe9', 'volume_name': 'volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba242e4-8cd7-40af-9570-a9138d3639b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba242e4-8cd7-40af-9570-a9138d3639b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a5495b-7133-47ac-8023-7ef74ddd1473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:04 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Volume c8558c7b-f675-46e1-bb92-2a4de4c12fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9', 'volume_size': 1} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:04 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0" returned: 0 in 0.501s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2061003726',display_name='tempest-VolumesGetTest-Volume-1119971720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8558c7b-f675-46e1-bb92-2a4de4c12fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:05Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Creating volume c8558c7b-f675-46e1-bb92-2a4de4c12fe9 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:04 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:04 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 1073741824 Nov 06 21:25:04 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce2d4d8-e6a8-4fcc-a7d4-0750911e5344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222912ec-045d-4ff3-9520-d95c564428d0', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:04 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9491c58a-49b0-4897-b916-e3ddb9309476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:05 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Volume volume-222912ec-045d-4ff3-9520-d95c564428d0 (222912ec-045d-4ff3-9520-d95c564428d0): created successfully Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9491c58a-49b0-4897-b916-e3ddb9309476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Flow 'volume_create_manager' (70beb84e-b6cf-4e0c-a195-bd02c3052d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a6079b5c-2b7b-4d48-b9e4-67c20b6fe0e9 tempest-VolumesTestJSON-1916617303 None] Created volume successfully. Nov 06 21:25:05 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 1073741824" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:05 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 Nov 06 21:25:05 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:05 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9" returned: 0 in 0.285s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.789s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Creating offline snapshot 1dea6a5c-48fd-466e-91d5-5045530ce17d of volume 12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a5495b-7133-47ac-8023-7ef74ddd1473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c74f444-04a0-46e0-b234-ca66df7f697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[50036f1f-0b87-4eba-8117-1ea23d32ccaf]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:05 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Volume volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 (c8558c7b-f675-46e1-bb92-2a4de4c12fe9): created successfully Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c74f444-04a0-46e0-b234-ca66df7f697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (76d085fc-fb41-4671-b4ac-14abfec7a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-daef3d6e-cf0e-4501-a954-e9a14747e34e tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:25:05 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 Nov 06 21:25:05 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" returned: 0 in 0.515s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d 1G Nov 06 21:25:06 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-1280f9f4-1ad2-44c8-aaa4-2e074c88dfe6 req-80b18ae9-b9cb-41c3-a68c-7f5134606134 tempest-TestMinimumBasicScenario-2137977404 None] Terminate volume connection completed successfully. Nov 06 21:25:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-1280f9f4-1ad2-44c8-aaa4-2e074c88dfe6 req-80b18ae9-b9cb-41c3-a68c-7f5134606134 tempest-TestMinimumBasicScenario-2137977404 None] Deleting attachment 82534003-c20e-4336-81b0-84e3e936922d. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:25:06 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d 1G" returned: 0 in 0.532s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:06 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d Nov 06 21:25:06 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-c8558c7b-f675-46e1-bb92-2a4de4c12fe9-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Lock "cinder-c8558c7b-f675-46e1-bb92-2a4de4c12fe9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-c8558c7b-f675-46e1-bb92-2a4de4c12fe9" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Acquiring lock "cinder-222912ec-045d-4ff3-9520-d95c564428d0-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-c8558c7b-f675-46e1-bb92-2a4de4c12fe9" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Lock "cinder-222912ec-045d-4ff3-9520-d95c564428d0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3546b1-6a33-44a0-8273-9c06084da53c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=87,cinder:UPDATE=133,cinder:INSERT=27,cinder:DELETE=12 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Acquiring lock "cinder-quobyte-222912ec-045d-4ff3-9520-d95c564428d0" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Lock "cinder-quobyte-222912ec-045d-4ff3-9520-d95c564428d0" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d075c0a-fc98-4200-bc8c-3d97728604a7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d" returned: 0 in 0.469s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d is being set with open permissions: ugo+rw Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 Nov 06 21:25:07 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Acquiring lock "cinder-f3c8211a-6046-43e0-b342-eea92ccb438c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:07 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d Nov 06 21:25:07 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Lock "cinder-f3c8211a-6046-43e0-b342-eea92ccb438c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Acquiring lock "cinder-quobyte-f3c8211a-6046-43e0-b342-eea92ccb438c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Lock "cinder-quobyte-f3c8211a-6046-43e0-b342-eea92ccb438c" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:07 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 Nov 06 21:25:07 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4fe079-9144-409d-8326-bf685fec7f00]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c Nov 06 21:25:07 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d" returned: 0 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9" returned: 0 in 0.485s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=111,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=12 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:25:07 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9 Nov 06 21:25:07 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info Nov 06 21:25:07 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0" returned: 0 in 0.484s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0 Nov 06 21:25:07 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c" returned: 0 in 0.409s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:07 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c Nov 06 21:25:07 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:07 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8558c7b-f675-46e1-bb92-2a4de4c12fe9" returned: 0 in 0.282s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-c8558c7b-f675-46e1-bb92-2a4de4c12fe9" released by "delete_volume" :: held 0.855s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:08 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info" returned: 0 in 0.280s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info is being set with open permissions: ugo+rw Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info Nov 06 21:25:08 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Created reservations ['a70bb480-b127-4ed7-a4f5-f117542a914f', '2823c705-c416-48c3-8c18-17dbb80b5f11', 'f15e73e6-7c19-4097-b983-c143a99f88bd', '7f0faffe-51bd-4302-875e-5e774bfce358'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:08 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-222912ec-045d-4ff3-9520-d95c564428d0" returned: 0 in 0.358s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:08 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Lock "cinder-quobyte-222912ec-045d-4ff3-9520-d95c564428d0" released by "delete_volume" :: held 0.914s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:08 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f3c8211a-6046-43e0-b342-eea92ccb438c" returned: 0 in 0.311s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Lock "cinder-quobyte-f3c8211a-6046-43e0-b342-eea92ccb438c" released by "delete_volume" :: held 0.804s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Created reservations ['fba184d8-f0c7-4bea-a0bd-d0f643eda0e8', '7cf1f6ac-aaa0-4b93-8a1e-037c8cddb5ac', 'bc5b1d51-b147-4b0f-8281-3ec297114f3e', '1a5c0313-e183-4bee-9f97-13c0fa627c52'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-df4c5c26-8192-419b-b135-3434f4a504dc-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Lock "cinder-df4c5c26-8192-419b-b135-3434f4a504dc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:08 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.info" returned: 0 in 0.379s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:08 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Created reservations ['bd6cf1ec-7974-40c8-a827-07489f59ea48', 'f2164dc5-66d1-44ef-86ef-9b853504c046', 'f782e27a-51f9-418e-a22e-a1e4f6c79e45', '38a62a6b-ec17-4a9a-a9d3-5dd772f47c99'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.329s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-df4c5c26-8192-419b-b135-3434f4a504dc" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-df4c5c26-8192-419b-b135-3434f4a504dc" acquired by "delete_volume" :: waited 0.055s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:08 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:08 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a152d-4b7a-45cb-9ede-03d095a805af]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d5dd620e-d72d-4f11-9861-453f398cf633 tempest-VolumesGetTest-801405821 None] Lock "cinder-c8558c7b-f675-46e1-bb92-2a4de4c12fe9-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-66bf8060-6adf-4127-81a7-3ba054e6c6dd tempest-VolumesSnapshotTestJSON-938610065 None] Create snapshot completed successfully Nov 06 21:25:08 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:08 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:08 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc Nov 06 21:25:08 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:08 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Deleted volume successfully. Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4e53def-1833-4ddc-bf6d-c75ecf8f4f5f tempest-VolumesTestJSON-1916617303 None] Lock "cinder-222912ec-045d-4ff3-9520-d95c564428d0-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:08 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:08 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Deleted volume successfully. Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9fd49861-9e34-4da7-8d9b-59264deeabb9 tempest-TestMinimumBasicScenario-2137977404 None] Lock "cinder-f3c8211a-6046-43e0-b342-eea92ccb438c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:09 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc Nov 06 21:25:09 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df4c5c26-8192-419b-b135-3434f4a504dc" returned: 0 in 0.250s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-df4c5c26-8192-419b-b135-3434f4a504dc" released by "delete_volume" :: held 0.674s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-1dea6a5c-48fd-466e-91d5-5045530ce17d-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Created reservations ['3ab7e33f-e464-460b-aec9-0d91bc4a8823', '76356e72-93a7-4061-929a-060604dea8a7', '4a307912-c847-4a60-8b6a-1afaefa82abd', 'e2768de9-f1bf-4529-a4dc-d96adf748c67'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-1dea6a5c-48fd-466e-91d5-5045530ce17d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Acquiring lock "cinder-d4bbf56e-f273-4820-b0b5-6596c156c780-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Lock "cinder-d4bbf56e-f273-4820-b0b5-6596c156c780-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-1dea6a5c-48fd-466e-91d5-5045530ce17d" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:09 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-1dea6a5c-48fd-466e-91d5-5045530ce17d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Deleting offline snapshot 1dea6a5c-48fd-466e-91d5-5045530ce17d of volume 12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] snapshot_file for this snap is: volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Acquiring lock "cinder-quobyte-d4bbf56e-f273-4820-b0b5-6596c156c780" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bec7cc-6bd2-4d3f-a307-188835623427]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Lock "cinder-quobyte-d4bbf56e-f273-4820-b0b5-6596c156c780" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-ad0eeb0f-0896-4433-8532-5cc07b914798-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bcb1c0-e0ce-429d-81f5-f41ca7adddc9]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Lock "cinder-ad0eeb0f-0896-4433-8532-5cc07b914798-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-ad0eeb0f-0896-4433-8532-5cc07b914798" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:09 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d Nov 06 21:25:09 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-ad0eeb0f-0896-4433-8532-5cc07b914798" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4aac89-7b06-4a83-ba14-ac61470ebfbb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:09 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 Nov 06 21:25:09 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:09 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.424s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:09 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3fc6283-e513-4841-8d2f-09a803d74ccb tempest-VolumesGetTest-801405821 None] Lock "cinder-df4c5c26-8192-419b-b135-3434f4a504dc-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:10 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 Nov 06 21:25:10 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d" returned: 0 in 0.542s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f6128-f719-44e9-abcc-469993a6ecc7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:10 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780" returned: 0 in 0.699s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:10 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780 Nov 06 21:25:10 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 Nov 06 21:25:10 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798" returned: 0 in 0.843s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:10 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798 Nov 06 21:25:10 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:10 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d4bbf56e-f273-4820-b0b5-6596c156c780" returned: 0 in 0.490s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Lock "cinder-quobyte-d4bbf56e-f273-4820-b0b5-6596c156c780" released by "delete_volume" :: held 1.265s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:10 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" returned: 0 in 0.738s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d Nov 06 21:25:11 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Created reservations ['6b7f1929-d378-4ff1-ba6e-e763443af46f', '3dda5d97-8018-4ea3-889c-53a5f751b4d6', '69318a9a-3af9-4f9b-8737-5b3b536b0b38', '01e67626-d123-48a9-88c2-11dbc6f57e9d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:11 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad0eeb0f-0896-4433-8532-5cc07b914798" returned: 0 in 0.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-ad0eeb0f-0896-4433-8532-5cc07b914798" released by "delete_volume" :: held 1.316s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:11 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Created reservations ['38088538-259c-419f-ad82-f67ca39c1b01', '9fc3176d-2adf-47e8-a731-357715804fec', '765d503d-c0e1-46db-add7-af99c522d08e', '3901044d-3fd0-44dc-bdbe-4d78a572ae86'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:11 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d" returned: 0 in 0.507s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:11 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:11 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d Nov 06 21:25:11 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Deleted volume successfully. Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0e2dfbd7-4e81-4165-82a3-857d1454c4ad tempest-VolumesTestJSON-1916617303 None] Lock "cinder-d4bbf56e-f273-4820-b0b5-6596c156c780-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:11 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.314s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9006061b-cc78-4903-9a08-421ba2590831 tempest-VolumesGetTest-801405821 None] Lock "cinder-ad0eeb0f-0896-4433-8532-5cc07b914798-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:11 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8.1dea6a5c-48fd-466e-91d5-5045530ce17d" returned: 0 in 0.362s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "cinder-7e12833f-fe77-4cce-87d3-2857761fa34b-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Lock "cinder-7e12833f-fe77-4cce-87d3-2857761fa34b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-1dea6a5c-48fd-466e-91d5-5045530ce17d" released by "_delete_snapshot" :: held 2.379s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" released by "delete_snapshot" :: held 2.421s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "cinder-quobyte-7e12833f-fe77-4cce-87d3-2857761fa34b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Lock "cinder-quobyte-7e12833f-fe77-4cce-87d3-2857761fa34b" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa2c92-b603-4e39-8703-3a47202c8749]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['e70df912-191a-4cbc-9c86-84469717382a', '006b5a4b-cd3e-4913-a86f-ce93af148266', '3d57af6e-b0ef-4ab8-a0f0-42cb94a76353', 'ac3a9480-0fa7-45ad-8429-4e22ce2dc323'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:12 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Delete snapshot completed successfully. Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c75232e9-60b0-47c5-a4d3-916fd9123472 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-1dea6a5c-48fd-466e-91d5-5045530ce17d-delete_snapshot" released by "delete_snapshot" :: held 2.769s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:12 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b Nov 06 21:25:12 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b" returned: 0 in 0.455s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:12 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b Nov 06 21:25:12 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:12 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7e12833f-fe77-4cce-87d3-2857761fa34b" returned: 0 in 0.278s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Lock "cinder-quobyte-7e12833f-fe77-4cce-87d3-2857761fa34b" released by "delete_volume" :: held 0.790s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Created reservations ['e2ba0b7d-dfbe-4650-b420-83ed95537027', '10aded92-c204-4623-ab33-597906c5fefb', '5eec7226-2c38-48ae-81af-b926baf785b4', '2b775b0c-540c-48fd-bf95-deb988bd50b4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:13 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (37cada42-867c-4b10-abd6-e6c063bbf202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6269790-be00-4333-a217-1751e05e3f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6269790-be00-4333-a217-1751e05e3f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1814757934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb9f593-5764-4412-b801-a881f0b8933f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:13Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427f1aa1-537b-4652-b823-335378271f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427f1aa1-537b-4652-b823-335378271f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab79a84-6019-41d4-aad5-5ee41d1af9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:25:13 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.453s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Deleted volume successfully. Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7bcb76ad-bb77-41ea-9b81-5766e21c4a05 tempest-VolumesTestJSON-1916617303 None] Lock "cinder-7e12833f-fe77-4cce-87d3-2857761fa34b-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (9d9ab8b9-ea1b-412d-8d02-eb9fa56203b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4f97ba-fb3d-4426-95ee-74e0213f66f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4f97ba-fb3d-4426-95ee-74e0213f66f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2015267655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b352db-7048-4fff-8a22-0ec7752ac162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:14Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b873706-cba7-4f87-ad2c-b616efe31b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b873706-cba7-4f87-ad2c-b616efe31b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0692d260-19da-4481-9f56-45877ab43885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0692d260-19da-4481-9f56-45877ab43885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b352db-7048-4fff-8a22-0ec7752ac162', 'volume_name': 'volume-c9b352db-7048-4fff-8a22-0ec7752ac162', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd5d7dd-c10b-43e4-8519-a21bc67efaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd5d7dd-c10b-43e4-8519-a21bc67efaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fc90ed-cc30-4908-868d-2e1655e6148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:13 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Volume c9b352db-7048-4fff-8a22-0ec7752ac162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b352db-7048-4fff-8a22-0ec7752ac162', 'volume_size': 1} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2015267655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b352db-7048-4fff-8a22-0ec7752ac162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:14Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Creating volume c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:13 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:13 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 1073741824 Nov 06 21:25:13 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab79a84-6019-41d4-aad5-5ee41d1af9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bb9f593-5764-4412-b801-a881f0b8933f', 'volume_name': 'volume-5bb9f593-5764-4412-b801-a881f0b8933f', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e8887c-34e9-4193-9457-713d59931cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e8887c-34e9-4193-9457-713d59931cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19572bc0-a50f-4e03-a48b-b21e5d3e5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Volume 5bb9f593-5764-4412-b801-a881f0b8933f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bb9f593-5764-4412-b801-a881f0b8933f', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Trying to clone 5bb9f593-5764-4412-b801-a881f0b8933f from image 0758c1e7-1e10-4850-a7cc-546025b05acd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:25:14 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 1073741824" returned: 0 in 0.589s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:14 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 Nov 06 21:25:14 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:25:14 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1301012-1a8f-41df-be6f-7002eb71e81d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:14 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162" returned: 0 in 0.317s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fc90ed-cc30-4908-868d-2e1655e6148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b352db-7048-4fff-8a22-0ec7752ac162', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5c9646-a253-424e-a339-310b811049ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:14 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Volume volume-c9b352db-7048-4fff-8a22-0ec7752ac162 (c9b352db-7048-4fff-8a22-0ec7752ac162): created successfully Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5c9646-a253-424e-a339-310b811049ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:14 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (9d9ab8b9-ea1b-412d-8d02-eb9fa56203b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:14 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD Nov 06 21:25:14 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-84812191-6b22-4378-8c38-6a310b26a7b2 tempest-VolumesSnapshotTestJSON-938610065 None] Created volume successfully. Nov 06 21:25:15 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd is fetched for user 9cdb9c6a45684a7e8d32120e221f6311. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6747343-c561-4982-aaba-908670ded8d6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD Nov 06 21:25:15 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1814757934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb9f593-5764-4412-b801-a881f0b8933f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:13Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Creating volume 5bb9f593-5764-4412-b801-a881f0b8933f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:15 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:15 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f 1073741824 Nov 06 21:25:15 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:16 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f 1073741824" returned: 0 in 0.528s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f Nov 06 21:25:16 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:16 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f" returned: 0 in 0.361s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.853s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Creating offline snapshot ca10571e-ad84-498e-8a86-f6aaea48fccb of volume c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Attempting download of 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 5bb9f593-5764-4412-b801-a881f0b8933f. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a99a1-9c84-462b-893b-1d9d33359913]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc61bc93-7c35-4e80-8df5-54fd7e2116b7]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:16 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 Nov 06 21:25:16 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:16 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco Nov 06 21:25:16 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco" returned: 0 in 0.331s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162" returned: 0 in 0.402s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb 1G Nov 06 21:25:17 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco Nov 06 21:25:17 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco" returned: 1 in 0.390s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_cmmofhco' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c78d202-c9e0-435b-9e2a-b2b2417f399f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb 1G" returned: 0 in 0.494s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b352db-7048-4fff-8a22-0ec7752ac162 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD Nov 06 21:25:17 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b352db-7048-4fff-8a22-0ec7752ac162 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb Nov 06 21:25:17 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:17 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] 0758c1e7-1e10-4850-a7cc-546025b05acd was qcow2, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:25:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:17 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f Nov 06 21:25:17 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:18 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9b352db-7048-4fff-8a22-0ec7752ac162 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb" returned: 0 in 0.456s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:18 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb is being set with open permissions: ugo+rw Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:18 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb Nov 06 21:25:18 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1cde04a-d6b0-49e3-b288-e92c50c15e02 tempest-BackendsCapabilitiesAdminTestsJSON-1047189322 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f4887b98-07ca-4455-bfc8-1a23a896a7c6 tempest-BackendsCapabilitiesAdminTestsJSON-1047189322 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 06 21:25:18 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb" returned: 0 in 0.316s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:18 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info Nov 06 21:25:18 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:18 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info" returned: 0 in 0.337s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:18 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info is being set with open permissions: ugo+rw Nov 06 21:25:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:18 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info Nov 06 21:25:18 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:19 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.info" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ec79559c-961f-4a3d-a121-a06972e0bc58 tempest-VolumesSnapshotTestJSON-938610065 None] Create snapshot completed successfully Nov 06 21:25:20 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f" returned: 0 in 2.516s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_dlgx4y9mdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:25:20 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Converted 112.00 MB image at 44.47 MB/s Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:20 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f 1G Nov 06 21:25:20 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (3325948a-f8b9-40a4-bd31-3a358e84048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c215fd1d-cef2-4a90-8296-82e220cf07ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c215fd1d-cef2-4a90-8296-82e220cf07ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538266234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0992aa3-919c-4485-b881-260da3460202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ca10571e-ad84-498e-8a86-f6aaea48fccb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:21Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be56c0e-8d80-4e71-ba77-086d6401d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be56c0e-8d80-4e71-ba77-086d6401d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28495a09-dcd3-4c0a-8cda-a749d9e149c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28495a09-dcd3-4c0a-8cda-a749d9e149c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0992aa3-919c-4485-b881-260da3460202', 'volume_name': 'volume-e0992aa3-919c-4485-b881-260da3460202', 'volume_size': 2, 'snapshot_id': 'ca10571e-ad84-498e-8a86-f6aaea48fccb'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6750f460-5ffb-40be-9bcc-26dec04022d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6750f460-5ffb-40be-9bcc-26dec04022d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee346c08-f7bb-4572-aef9-fb49a5a8b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:20 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Volume e0992aa3-919c-4485-b881-260da3460202: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0992aa3-919c-4485-b881-260da3460202', 'volume_size': 2, 'snapshot_id': 'ca10571e-ad84-498e-8a86-f6aaea48fccb'} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-ca10571e-ad84-498e-8a86-f6aaea48fccb-e0992aa3-919c-4485-b881-260da3460202" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-ca10571e-ad84-498e-8a86-f6aaea48fccb-e0992aa3-919c-4485-b881-260da3460202" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Creating volume e0992aa3-919c-4485-b881-260da3460202 from snapshot ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-e0992aa3-919c-4485-b881-260da3460202" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-e0992aa3-919c-4485-b881-260da3460202" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] snapshot: ca10571e-ad84-498e-8a86-f6aaea48fccb, volume: e0992aa3-919c-4485-b881-260da3460202, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553f067-7186-4f2e-a667-ab115dbddb25]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:21 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f 1G" returned: 0 in 0.626s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Downloaded image 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 5bb9f593-5764-4412-b801-a881f0b8933f successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd for user 9cdb9c6a45684a7e8d32120e221f6311 is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Marking volume 5bb9f593-5764-4412-b801-a881f0b8933f as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Copying metadata from image 0758c1e7-1e10-4850-a7cc-546025b05acd to 5bb9f593-5764-4412-b801-a881f0b8933f. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Creating volume glance metadata for volume 5bb9f593-5764-4412-b801-a881f0b8933f backed by image 0758c1e7-1e10-4850-a7cc-546025b05acd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19572bc0-a50f-4e03-a48b-b21e5d3e5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb9f593-5764-4412-b801-a881f0b8933f', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71743aba-cc2f-4df6-b503-cd205f62c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:21 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Volume volume-5bb9f593-5764-4412-b801-a881f0b8933f (5bb9f593-5764-4412-b801-a881f0b8933f): created successfully Nov 06 21:25:21 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71743aba-cc2f-4df6-b503-cd205f62c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:21 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (37cada42-867c-4b10-abd6-e6c063bbf202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a31bb469-1176-455f-a79e-8903e3b448f9 tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:25:21 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb" returned: 0 in 0.481s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b352db-7048-4fff-8a22-0ec7752ac162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[846be152-b2f4-44df-9dec-0f37474a6d50]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:21 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 Nov 06 21:25:21 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:22 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162" returned: 0 in 0.511s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:22 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 Nov 06 21:25:22 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (3a6f90d8-6966-4516-9fb3-2aacc436f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7843d43-9a5c-441e-bf18-d7e947c83154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7843d43-9a5c-441e-bf18-d7e947c83154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2136242567',display_name='tempest-VolumesGetTest-Volume-1907837430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addd5d98-f6d5-4ba6-b3d4-82eeb93179d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:23Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084fdf56-1b8a-49f8-abb4-ae663bd2c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084fdf56-1b8a-49f8-abb4-ae663bd2c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2c1074-a25e-4ee8-99a0-0728242a7d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2c1074-a25e-4ee8-99a0-0728242a7d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addd5d98-f6d5-4ba6-b3d4-82eeb93179d8', 'volume_name': 'volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9397b77b-8a8b-4039-9cd8-be554f9b45a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9397b77b-8a8b-4039-9cd8-be554f9b45a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059a0c79-1a19-45df-ac70-b1694eb7883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:22 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Volume addd5d98-f6d5-4ba6-b3d4-82eeb93179d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8', 'volume_size': 1} Nov 06 21:25:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c71d3a2a-9947-4da3-84ae-17be6d50463d tempest-GroupsTest-460773422 None] Group tempest-Group1-1492515061: creating Nov 06 21:25:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c71d3a2a-9947-4da3-84ae-17be6d50463d tempest-GroupsTest-460773422 None] Group tempest-Group1-1492515061: created successfully Nov 06 21:25:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c71d3a2a-9947-4da3-84ae-17be6d50463d tempest-GroupsTest-460773422 None] Create group completed successfully. Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-84d74cb4-39f3-470f-b162-8a76491d417f tempest-GroupsTest-460773422 None] Group tempest-Group2-481152165: creating Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-84d74cb4-39f3-470f-b162-8a76491d417f tempest-GroupsTest-460773422 None] Group tempest-Group2-481152165: created successfully Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-84d74cb4-39f3-470f-b162-8a76491d417f tempest-GroupsTest-460773422 None] Create group completed successfully. Nov 06 21:25:30 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202" returned: 0 in 8.112s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Converted 1024.00 MB image at 126.18 MB/s Nov 06 21:25:30 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 is being set with open permissions: ugo+rw Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:30 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 Nov 06 21:25:30 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:30 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202" returned: 0 in 0.256s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-e0992aa3-919c-4485-b881-260da3460202" released by "_copy_volume_from_snapshot" :: held 9.514s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-ca10571e-ad84-498e-8a86-f6aaea48fccb-e0992aa3-919c-4485-b881-260da3460202" released by "_create_volume_from_snapshot" :: held 9.613s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.644s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.588s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2136242567',display_name='tempest-VolumesGetTest-Volume-1907837430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addd5d98-f6d5-4ba6-b3d4-82eeb93179d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96989e45fe874c019ee6251a2765f91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:23Z,use_quota=True,user_id='9cdb9c6a45684a7e8d32120e221f6311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Creating volume addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:30 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 1073741824 Nov 06 21:25:30 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee346c08-f7bb-4572-aef9-fb49a5a8b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0992aa3-919c-4485-b881-260da3460202', 'volume_size': 2, 'snapshot_id': 'ca10571e-ad84-498e-8a86-f6aaea48fccb'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae525c4-0776-4b81-b0da-55f3ef7a2b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Volume volume-e0992aa3-919c-4485-b881-260da3460202 (e0992aa3-919c-4485-b881-260da3460202): created successfully Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae525c4-0776-4b81-b0da-55f3ef7a2b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (3325948a-f8b9-40a4-bd31-3a358e84048b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6863fe6a-5fe3-4b56-90cc-21e8e9f448bb tempest-VolumesSnapshotTestJSON-938610065 None] Created volume successfully. Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-e0992aa3-919c-4485-b881-260da3460202-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-e0992aa3-919c-4485-b881-260da3460202-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-e0992aa3-919c-4485-b881-260da3460202" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-e0992aa3-919c-4485-b881-260da3460202" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1861c-eb1a-44b2-bc3b-61cc32fbd8bd]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 1073741824" returned: 0 in 0.574s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 Nov 06 21:25:31 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 Nov 06 21:25:31 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8" returned: 0 in 0.333s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:31 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202" returned: 0 in 0.521s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059a0c79-1a19-45df-ac70-b1694eb7883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69522a6-ee54-44f2-bf55-4c517b9bbe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202 Nov 06 21:25:31 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Volume volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 (addd5d98-f6d5-4ba6-b3d4-82eeb93179d8): created successfully Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69522a6-ee54-44f2-bf55-4c517b9bbe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Flow 'volume_create_manager' (3a6f90d8-6966-4516-9fb3-2aacc436f571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-72060692-469d-41d3-8444-27b05fc1f44e tempest-VolumesGetTest-801405821 None] Created volume successfully. Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Flow 'volume_create_manager' (4e444ee7-1295-4c91-981d-6745b8a6d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:31 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4faf65-4f69-44c8-982a-99e7e41c724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e0992aa3-919c-4485-b881-260da3460202" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4faf65-4f69-44c8-982a-99e7e41c724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1234758197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b02dcbc3-45e9-4a95-9dfc-1e90ade126b0,host='devstack@QuobyteHD#QuobyteHD',id=b3043db3-6261-49da-9fff-4f8b3b1afd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d9356814934479be22be87808d77f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:32Z,use_quota=True,user_id='6395999673f747b985ea5c213664510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(272e450f-fd44-4038-916d-766a4c0d8f3f),volume_type_id=272e450f-fd44-4038-916d-766a4c0d8f3f)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c425ddc-4193-48bd-9279-9c330b0e6cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c425ddc-4193-48bd-9279-9c330b0e6cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aabb2a-f950-4409-92cd-2a053356baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aabb2a-f950-4409-92cd-2a053356baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3043db3-6261-49da-9fff-4f8b3b1afd6e', 'volume_name': 'volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8a428b-8b6a-41ae-9ef1-11f570a4bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8a428b-8b6a-41ae-9ef1-11f570a4bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2738a8f5-39ed-4468-93d0-426fc69967d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Volume b3043db3-6261-49da-9fff-4f8b3b1afd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e', 'volume_size': 1} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b02dcbc3-45e9-4a95-9dfc-1e90ade126b0,created_at=2026-11-06T20:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1234758197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b02dcbc3-45e9-4a95-9dfc-1e90ade126b0,host='devstack@QuobyteHD#QuobyteHD',id=b3043db3-6261-49da-9fff-4f8b3b1afd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d9356814934479be22be87808d77f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:32Z,use_quota=True,user_id='6395999673f747b985ea5c213664510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(272e450f-fd44-4038-916d-766a4c0d8f3f),volume_type_id=272e450f-fd44-4038-916d-766a4c0d8f3f)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Creating volume b3043db3-6261-49da-9fff-4f8b3b1afd6e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:31 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-e0992aa3-919c-4485-b881-260da3460202" released by "delete_volume" :: held 0.995s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:31 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e 1073741824 Nov 06 21:25:31 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['91272b54-5a86-4666-ad7b-ae388a9199cf', 'e5b5219e-f166-4c88-9fde-1669590f6ed2', '796f7a69-d18f-4723-beaf-c70e4b79dd15', '69aea8b6-3028-4277-b24d-9bf734ae5d80'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:32 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:32 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.327s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:32 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.311s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:32 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Deleted volume successfully. Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c3d94ad6-5ec6-43ba-8aad-d4d309c90f6d tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-e0992aa3-919c-4485-b881-260da3460202-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:25:32 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e 1073741824" returned: 0 in 0.633s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e Nov 06 21:25:32 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Lock "cinder-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f826354-e11e-4d7a-ad85-fd82062222bc]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:32 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2738a8f5-39ed-4468-93d0-426fc69967d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f2ea89-df5e-41d9-9290-c080b0c8fa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:33 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Volume volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e (b3043db3-6261-49da-9fff-4f8b3b1afd6e): created successfully Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f2ea89-df5e-41d9-9290-c080b0c8fa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Flow 'volume_create_manager' (4e444ee7-1295-4c91-981d-6745b8a6d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3a935b80-c605-4004-9cd2-9571027e233c tempest-GroupsTest-460773422 None] Created volume successfully. Nov 06 21:25:33 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 Nov 06 21:25:33 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-ca10571e-ad84-498e-8a86-f6aaea48fccb-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-ca10571e-ad84-498e-8a86-f6aaea48fccb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-c9b352db-7048-4fff-8a22-0ec7752ac162" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-c9b352db-7048-4fff-8a22-0ec7752ac162" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-ca10571e-ad84-498e-8a86-f6aaea48fccb" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-ca10571e-ad84-498e-8a86-f6aaea48fccb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Deleting offline snapshot ca10571e-ad84-498e-8a86-f6aaea48fccb of volume c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] snapshot_file for this snap is: volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[154dac3d-5d99-4e16-847b-573cc473681c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8" returned: 0 in 0.468s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8 Nov 06 21:25:33 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb Nov 06 21:25:33 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8" returned: 0 in 0.270s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8" released by "delete_volume" :: held 0.793s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Created reservations ['806314d2-42fb-4d4e-8ef9-6362657b009b', 'd0a4b239-2e83-4d17-8339-eb3d3c357c3f', '1c2867a8-49d9-4474-b65e-55718cbb4149', '28d75ffe-a7cb-41ae-9663-a42f58e041e6'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:33 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb" returned: 0 in 0.429s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9b352db-7048-4fff-8a22-0ec7752ac162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0938ff-e931-4de3-a9cc-29094c9d0d70]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:33 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:33 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:33 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 Nov 06 21:25:33 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-5bb9f593-5764-4412-b801-a881f0b8933f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Lock "cinder-5bb9f593-5764-4412-b801-a881f0b8933f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Acquiring lock "cinder-quobyte-5bb9f593-5764-4412-b801-a881f0b8933f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-5bb9f593-5764-4412-b801-a881f0b8933f" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f67ac95-768e-48f2-8b06-fc6a6b7fc41c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:34 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.435s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:25:34 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-8646bda0-8616-49da-be78-2c086e7d276e tempest-VolumesGetTest-801405821 None] Lock "cinder-addd5d98-f6d5-4ba6-b3d4-82eeb93179d8-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:34 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162" returned: 0 in 0.730s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:34 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb Nov 06 21:25:34 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f" returned: 0 in 0.433s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:34 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f Nov 06 21:25:34 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb" returned: 0 in 0.403s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:34 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb Nov 06 21:25:34 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:34 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5bb9f593-5764-4412-b801-a881f0b8933f" returned: 0 in 0.331s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Lock "cinder-quobyte-5bb9f593-5764-4412-b801-a881f0b8933f" released by "delete_volume" :: held 0.840s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Created reservations ['efea035a-de6d-429e-940f-a5f0b2668e93', '8e8c4128-fa3e-4f3d-974c-8a73f06550ef', '099ac379-731a-4af6-805a-084935dac182', '25959f3e-1d6e-417e-b850-d009af50c630'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:35 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:35 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:35 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162.ca10571e-ad84-498e-8a86-f6aaea48fccb" returned: 0 in 0.351s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-ca10571e-ad84-498e-8a86-f6aaea48fccb" released by "_delete_snapshot" :: held 2.071s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-c9b352db-7048-4fff-8a22-0ec7752ac162" released by "delete_snapshot" :: held 2.130s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Acquiring lock "cinder-quobyte-b3043db3-6261-49da-9fff-4f8b3b1afd6e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Lock "cinder-quobyte-b3043db3-6261-49da-9fff-4f8b3b1afd6e" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b0d84-1914-45f4-ac97-452dd8d06457]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['34b9abff-807c-4942-89a5-220c44a6af7b', '6834323c-47f3-482c-b049-abc96b490c11', 'af3b0ab1-0176-419a-b2e8-82e6e186601e', '7614e499-98d7-4bb5-b256-01e4a796af0d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:35 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Deleted volume successfully. Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-77747eca-c1b4-4c0e-835a-b5b66f35a178 tempest-VolumesGetTest-801405821 None] Lock "cinder-5bb9f593-5764-4412-b801-a881f0b8933f-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:35 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e Nov 06 21:25:35 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Delete snapshot completed successfully. Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-222595d0-b145-48ce-af4d-196cdbd120d4 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-ca10571e-ad84-498e-8a86-f6aaea48fccb-delete_snapshot" released by "delete_snapshot" :: held 2.440s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:35 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e" returned: 0 in 0.443s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:35 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e Nov 06 21:25:35 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:36 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b3043db3-6261-49da-9fff-4f8b3b1afd6e" returned: 0 in 0.275s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Lock "cinder-quobyte-b3043db3-6261-49da-9fff-4f8b3b1afd6e" released by "delete_volume" :: held 0.803s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Created reservations ['771fe1a3-67c6-4049-8593-a28683b26271'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:36 devstack cinder-volume[87350]: WARNING cinder.quota [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1874856029 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1874856029, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:36 devstack cinder-volume[87350]: WARNING cinder.quota [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1874856029 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1874856029, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Created reservations ['f2c71022-ff41-4246-8145-1843418430bf', '6d9d4fbf-ba88-4c9e-b613-50e964834923', 'c6729c55-062b-414c-be06-e737c681c4ca', '56fa6de6-d83b-48ce-ab1e-9ac59c58abbf'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:36 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:36 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-c9b352db-7048-4fff-8a22-0ec7752ac162-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-c9b352db-7048-4fff-8a22-0ec7752ac162-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-c9b352db-7048-4fff-8a22-0ec7752ac162" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-c9b352db-7048-4fff-8a22-0ec7752ac162" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f6003-e1be-4ed1-99ec-7a8caaedd463]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:36 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:36 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-764b8885-db77-41b3-8583-f36cae2b70b7 tempest-GroupsTest-460773422 None] Delete group completed successfully. Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Created reservations ['7d8c9e0b-9e9d-4233-9cb4-e38b4b450164'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:37 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 Nov 06 21:25:37 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:37 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:37 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:37 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162" returned: 0 in 0.549s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.372s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:37 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162 Nov 06 21:25:37 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e0d11506-e91d-45cc-90c9-91ac60ba2250 tempest-GroupsTest-460773422 None] Delete group completed successfully. Nov 06 21:25:37 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c9b352db-7048-4fff-8a22-0ec7752ac162" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-c9b352db-7048-4fff-8a22-0ec7752ac162" released by "delete_volume" :: held 0.949s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['814113b0-4eec-4e26-b677-0c7f09c6be7b', '7087751a-f1d9-4d4e-87bf-20ebb14e72f8', 'fe0af7ef-2525-4305-87e0-ed0f7b25a14f', 'dd2478aa-9a0f-488c-a6a6-dd4b63a319cf'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:37 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:37 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:38 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.521s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:38 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Deleted volume successfully. Nov 06 21:25:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-20dd4d4d-1ef7-43f2-8ddb-98e0e40cd51c tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-c9b352db-7048-4fff-8a22-0ec7752ac162-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f4bb7427-9a5a-46e0-86ae-2de8b22b59be tempest-GroupsTest-460773422 None] Group tempest-GroupsTest-Group-887716245: creating Nov 06 21:25:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f4bb7427-9a5a-46e0-86ae-2de8b22b59be tempest-GroupsTest-460773422 None] Group tempest-GroupsTest-Group-887716245: created successfully Nov 06 21:25:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f4bb7427-9a5a-46e0-86ae-2de8b22b59be tempest-GroupsTest-460773422 None] Create group completed successfully. Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (dc8192ff-17eb-4451-9456-56f62868dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c5e6a-3de7-4cdf-acb9-fe6cabfc2cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c5e6a-3de7-4cdf-acb9-fe6cabfc2cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-713785969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31635b11-5128-43b5-977f-fedae07dfc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:40Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7144bc-f41c-474a-b9c5-9fd9084b00bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7144bc-f41c-474a-b9c5-9fd9084b00bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4045bd73-53e1-418d-b87e-f916d65e5ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4045bd73-53e1-418d-b87e-f916d65e5ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31635b11-5128-43b5-977f-fedae07dfc65', 'volume_name': 'volume-31635b11-5128-43b5-977f-fedae07dfc65', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d001e251-3a4e-4b05-9b33-e12b44e5241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d001e251-3a4e-4b05-9b33-e12b44e5241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e3700e-c867-4717-a185-16596b90ecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Volume 31635b11-5128-43b5-977f-fedae07dfc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31635b11-5128-43b5-977f-fedae07dfc65', 'volume_size': 1} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-713785969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31635b11-5128-43b5-977f-fedae07dfc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:40Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Creating volume 31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:39 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:39 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 1073741824 Nov 06 21:25:39 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:40 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 1073741824" returned: 0 in 0.765s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:40 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 Nov 06 21:25:40 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Flow 'volume_create_manager' (2ce673ea-4060-431b-b626-ede9d2621c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2296ce-8f22-4692-a254-6378fd258632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2296ce-8f22-4692-a254-6378fd258632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1346232545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f074960-b544-43e6-a877-8a43d5d2ad87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57874f1c0d1e4933bbbda1701198cf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:41Z,use_quota=True,user_id='1c74101982d24443bbe49815370d6fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a33e8e-d051-48b8-9c31-3b6a95bfc532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a33e8e-d051-48b8-9c31-3b6a95bfc532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2206c00-8ab7-423d-8565-1c5a8d78bdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2206c00-8ab7-423d-8565-1c5a8d78bdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f074960-b544-43e6-a877-8a43d5d2ad87', 'volume_name': 'volume-0f074960-b544-43e6-a877-8a43d5d2ad87', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3a12cd-837d-4549-be06-2efc3977c367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3a12cd-837d-4549-be06-2efc3977c367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f57314-67fd-4d4e-97ae-b8893ce43846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Volume 0f074960-b544-43e6-a877-8a43d5d2ad87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f074960-b544-43e6-a877-8a43d5d2ad87', 'volume_size': 1} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Flow 'volume_create_manager' (4aa10dd2-22fe-4654-9129-2e8808bd9b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893a24e3-77f3-4fef-afce-21093c6014ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893a24e3-77f3-4fef-afce-21093c6014ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-452098230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc1bfd6f-bc51-4c3d-a6ec-11183553ec32,host='devstack@QuobyteHD#QuobyteHD',id=c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d9356814934479be22be87808d77f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:41Z,use_quota=True,user_id='6395999673f747b985ea5c213664510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(593cf4ca-940b-46a9-a4ba-ea63b9cf4318),volume_type_id=593cf4ca-940b-46a9-a4ba-ea63b9cf4318)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304e9d61-10a0-4a39-bb15-5095b24be66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304e9d61-10a0-4a39-bb15-5095b24be66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6289d13f-bfec-4362-b526-128bffb62382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6289d13f-bfec-4362-b526-128bffb62382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb', 'volume_name': 'volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d16d0-32c0-4d66-ab0e-e8e3fa5c5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d16d0-32c0-4d66-ab0e-e8e3fa5c5384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6d64d6-8ce3-4e57-8866-0bef6c00f8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Volume c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb', 'volume_size': 1} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65" returned: 0 in 0.488s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1346232545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f074960-b544-43e6-a877-8a43d5d2ad87,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57874f1c0d1e4933bbbda1701198cf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:41Z,use_quota=True,user_id='1c74101982d24443bbe49815370d6fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Creating volume 0f074960-b544-43e6-a877-8a43d5d2ad87 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:41 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e3700e-c867-4717-a185-16596b90ecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31635b11-5128-43b5-977f-fedae07dfc65', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8c30ad-f146-44a6-927a-dc75255b9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:41 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 1073741824 Nov 06 21:25:41 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Volume volume-31635b11-5128-43b5-977f-fedae07dfc65 (31635b11-5128-43b5-977f-fedae07dfc65): created successfully Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8c30ad-f146-44a6-927a-dc75255b9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (dc8192ff-17eb-4451-9456-56f62868dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3f93b05e-9ae1-49a0-abf1-a600aa63ea7e tempest-VolumesSnapshotTestJSON-938610065 None] Created volume successfully. Nov 06 21:25:41 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 1073741824" returned: 0 in 0.610s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:41 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 Nov 06 21:25:41 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:42 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87" returned: 0 in 0.315s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc1bfd6f-bc51-4c3d-a6ec-11183553ec32,created_at=2026-11-06T20:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-452098230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc1bfd6f-bc51-4c3d-a6ec-11183553ec32,host='devstack@QuobyteHD#QuobyteHD',id=c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d9356814934479be22be87808d77f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:41Z,use_quota=True,user_id='6395999673f747b985ea5c213664510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(593cf4ca-940b-46a9-a4ba-ea63b9cf4318),volume_type_id=593cf4ca-940b-46a9-a4ba-ea63b9cf4318)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Creating volume c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:42 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:42 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb 1073741824 Nov 06 21:25:42 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f57314-67fd-4d4e-97ae-b8893ce43846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f074960-b544-43e6-a877-8a43d5d2ad87', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32f1deb-5ff8-462e-88b6-8c29f7614754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Volume volume-0f074960-b544-43e6-a877-8a43d5d2ad87 (0f074960-b544-43e6-a877-8a43d5d2ad87): created successfully Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32f1deb-5ff8-462e-88b6-8c29f7614754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Flow 'volume_create_manager' (2ce673ea-4060-431b-b626-ede9d2621c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-14044d61-fd04-462a-beb9-658a616f2885 tempest-VolumesListTestJSON-1077840043 None] Created volume successfully. Nov 06 21:25:42 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb 1073741824" returned: 0 in 0.573s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:42 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb Nov 06 21:25:42 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:43 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb" returned: 0 in 0.301s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6d64d6-8ce3-4e57-8866-0bef6c00f8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226c64d0-432c-4386-82a8-b3659d0b6325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Creating offline snapshot 153d0e1b-5153-4692-bf6c-0e3435819987 of volume 31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:25:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Volume volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb (c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb): created successfully Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226c64d0-432c-4386-82a8-b3659d0b6325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Flow 'volume_create_manager' (4aa10dd2-22fe-4654-9129-2e8808bd9b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecd794a-8a2c-4eac-8730-6dfa30912f55]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c39f61b7-e0d4-44f5-9363-9700c3822817 tempest-GroupsTest-460773422 None] Created volume successfully. Nov 06 21:25:43 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 Nov 06 21:25:43 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Flow 'volume_create_manager' (66821d20-4765-4004-b5c6-9a2dfa0acafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d28fde-4564-46cc-86dd-87e74fd98e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d28fde-4564-46cc-86dd-87e74fd98e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-894245676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4c4fef-637d-45aa-bf41-ab6560201701,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57874f1c0d1e4933bbbda1701198cf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:44Z,use_quota=True,user_id='1c74101982d24443bbe49815370d6fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3868b33-6ea8-4000-8474-661768e5d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3868b33-6ea8-4000-8474-661768e5d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8d0367-84c9-4e05-9e92-b8bdcc72e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8d0367-84c9-4e05-9e92-b8bdcc72e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4c4fef-637d-45aa-bf41-ab6560201701', 'volume_name': 'volume-aa4c4fef-637d-45aa-bf41-ab6560201701', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4060506-d735-4082-a66e-827adae60142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4060506-d735-4082-a66e-827adae60142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b0b82b-c851-4f7d-92b4-d75a58c936bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Volume aa4c4fef-637d-45aa-bf41-ab6560201701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4c4fef-637d-45aa-bf41-ab6560201701', 'volume_size': 1} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:43 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65" returned: 0 in 0.579s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:43 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 1G Nov 06 21:25:43 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Flow 'volume_create_manager' (bb28d83f-9260-4a4b-bee5-e7ee77ca6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2fe99-34e2-401a-8a16-ff153d2b4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2fe99-34e2-401a-8a16-ff153d2b4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228779856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc1bfd6f-bc51-4c3d-a6ec-11183553ec32,host='devstack@QuobyteHD#QuobyteHD',id=2b157f4b-d055-43cb-8e08-0d321c9cd0ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d9356814934479be22be87808d77f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:44Z,use_quota=True,user_id='6395999673f747b985ea5c213664510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(593cf4ca-940b-46a9-a4ba-ea63b9cf4318),volume_type_id=593cf4ca-940b-46a9-a4ba-ea63b9cf4318)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf004a3-fcbe-406b-9031-e9cc4ad63f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf004a3-fcbe-406b-9031-e9cc4ad63f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c6c103-c440-4b58-b0ae-80439d2eeeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c6c103-c440-4b58-b0ae-80439d2eeeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b157f4b-d055-43cb-8e08-0d321c9cd0ef', 'volume_name': 'volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e15aa3-9972-45da-a887-418db51f4b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e15aa3-9972-45da-a887-418db51f4b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a186ff3f-06de-4c06-901e-d0ac606555d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:44 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Volume 2b157f4b-d055-43cb-8e08-0d321c9cd0ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef', 'volume_size': 1} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:44 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 1G" returned: 0 in 0.565s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31635b11-5128-43b5-977f-fedae07dfc65 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:44 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31635b11-5128-43b5-977f-fedae07dfc65 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 Nov 06 21:25:44 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:44 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31635b11-5128-43b5-977f-fedae07dfc65 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987" returned: 0 in 0.353s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:44 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 is being set with open permissions: ugo+rw Nov 06 21:25:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:44 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 Nov 06 21:25:44 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:45 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info Nov 06 21:25:45 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info" returned: 0 in 0.328s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:45 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info is being set with open permissions: ugo+rw Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:45 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info Nov 06 21:25:45 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.info" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-894245676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4c4fef-637d-45aa-bf41-ab6560201701,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57874f1c0d1e4933bbbda1701198cf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:44Z,use_quota=True,user_id='1c74101982d24443bbe49815370d6fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Creating volume aa4c4fef-637d-45aa-bf41-ab6560201701 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:45 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:45 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 1073741824 Nov 06 21:25:45 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e069edde-fa35-48b8-825a-1fcee16e59ef tempest-VolumesSnapshotTestJSON-938610065 None] Create snapshot completed successfully Nov 06 21:25:46 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 1073741824" returned: 0 in 0.520s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:46 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 Nov 06 21:25:46 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:46 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701" returned: 0 in 0.280s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc1bfd6f-bc51-4c3d-a6ec-11183553ec32,created_at=2026-11-06T20:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1228779856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc1bfd6f-bc51-4c3d-a6ec-11183553ec32,host='devstack@QuobyteHD#QuobyteHD',id=2b157f4b-d055-43cb-8e08-0d321c9cd0ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d9356814934479be22be87808d77f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:44Z,use_quota=True,user_id='6395999673f747b985ea5c213664510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(593cf4ca-940b-46a9-a4ba-ea63b9cf4318),volume_type_id=593cf4ca-940b-46a9-a4ba-ea63b9cf4318)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Creating volume 2b157f4b-d055-43cb-8e08-0d321c9cd0ef {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:46 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:46 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef 1073741824 Nov 06 21:25:46 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b0b82b-c851-4f7d-92b4-d75a58c936bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4c4fef-637d-45aa-bf41-ab6560201701', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5ed46b-8be7-48d4-b005-dd578173286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:46 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Volume volume-aa4c4fef-637d-45aa-bf41-ab6560201701 (aa4c4fef-637d-45aa-bf41-ab6560201701): created successfully Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5ed46b-8be7-48d4-b005-dd578173286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Flow 'volume_create_manager' (66821d20-4765-4004-b5c6-9a2dfa0acafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5b88ee13-8e75-4219-89cd-fe97a7413253 tempest-VolumesListTestJSON-1077840043 None] Created volume successfully. Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (8df59b24-1edf-47a2-805c-d4aade8f6142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d0b29e-b200-429b-be71-8aa4974896af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d0b29e-b200-429b-be71-8aa4974896af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-138073808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a3ca2-3e05-4c04-aba0-1326aec2e78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0ed66ccd59c48f6a47fcff249987715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=153d0e1b-5153-4692-bf6c-0e3435819987,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:47Z,use_quota=True,user_id='0bc3dfb886dc4b048448d3ece523d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4f01f8-e83a-444b-84f7-3b56fd92b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4f01f8-e83a-444b-84f7-3b56fd92b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e94d7e5-5a80-41dd-88a8-6b08a628e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e94d7e5-5a80-41dd-88a8-6b08a628e76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '061a3ca2-3e05-4c04-aba0-1326aec2e78e', 'volume_name': 'volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e', 'volume_size': 1, 'snapshot_id': '153d0e1b-5153-4692-bf6c-0e3435819987'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480de90c-f272-4091-bf6d-764712ae83f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480de90c-f272-4091-bf6d-764712ae83f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efc0381-0f92-4686-8407-3e20137b4fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Volume 061a3ca2-3e05-4c04-aba0-1326aec2e78e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e', 'volume_size': 1, 'snapshot_id': '153d0e1b-5153-4692-bf6c-0e3435819987'} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:47 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef 1073741824" returned: 0 in 0.636s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:47 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef Nov 06 21:25:47 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:47 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef" returned: 0 in 0.343s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.462s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-153d0e1b-5153-4692-bf6c-0e3435819987-061a3ca2-3e05-4c04-aba0-1326aec2e78e" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Flow 'volume_create_manager' (05797a87-22a2-4dd7-ae28-9740887628fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf417fe-757b-4980-8a41-a5ee91e24a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a186ff3f-06de-4c06-901e-d0ac606555d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead824d-30f7-4233-9d09-f8ecb2838ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-153d0e1b-5153-4692-bf6c-0e3435819987-061a3ca2-3e05-4c04-aba0-1326aec2e78e" acquired by "_create_volume_from_snapshot" :: waited 0.085s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Creating volume 061a3ca2-3e05-4c04-aba0-1326aec2e78e from snapshot 153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-061a3ca2-3e05-4c04-aba0-1326aec2e78e" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf417fe-757b-4980-8a41-a5ee91e24a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-779936376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0827434b-5f03-467d-888f-d348e446b4ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57874f1c0d1e4933bbbda1701198cf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:48Z,use_quota=True,user_id='1c74101982d24443bbe49815370d6fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e503155-e642-45f4-9562-fbef2c9178c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e503155-e642-45f4-9562-fbef2c9178c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7b59d4-9a51-4eed-9c51-b595cd862f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7b59d4-9a51-4eed-9c51-b595cd862f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0827434b-5f03-467d-888f-d348e446b4ed', 'volume_name': 'volume-0827434b-5f03-467d-888f-d348e446b4ed', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f114a0b-3f9b-4d86-bda7-058c7b038219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f114a0b-3f9b-4d86-bda7-058c7b038219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af213164-77d6-475c-b136-4fd422b1d4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Volume 0827434b-5f03-467d-888f-d348e446b4ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0827434b-5f03-467d-888f-d348e446b4ed', 'volume_size': 1} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Volume volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef (2b157f4b-d055-43cb-8e08-0d321c9cd0ef): created successfully Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead824d-30f7-4233-9d09-f8ecb2838ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Flow 'volume_create_manager' (bb28d83f-9260-4a4b-bee5-e7ee77ca6407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-061a3ca2-3e05-4c04-aba0-1326aec2e78e" acquired by "_copy_volume_from_snapshot" :: waited 0.097s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] snapshot: 153d0e1b-5153-4692-bf6c-0e3435819987, volume: 061a3ca2-3e05-4c04-aba0-1326aec2e78e, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-222f3d72-0669-4646-9bc4-1860698d79db tempest-GroupsTest-460773422 None] Created volume successfully. Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[63baf76a-56b2-44a1-be8f-6f11a8a49ce5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:48 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 Nov 06 21:25:48 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:48 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987" returned: 0 in 0.412s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31635b11-5128-43b5-977f-fedae07dfc65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c9c2d1-032c-4078-aeec-b61f9f677657]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:48 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 Nov 06 21:25:48 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:48 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65" returned: 0 in 0.381s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:25:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:48 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e Nov 06 21:25:48 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-85ef7f6d-ac1b-44fc-96f2-ce553e99c696 tempest-GroupsTest-460773422 None] Update group completed successfully. Nov 06 21:25:51 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a082382b-74d3-43df-85ea-a977a3bc8e9d tempest-GroupsTest-460773422 None] Update group completed successfully. Nov 06 21:25:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Acquiring lock "cinder-quobyte-2b157f4b-d055-43cb-8e08-0d321c9cd0ef" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Lock "cinder-quobyte-2b157f4b-d055-43cb-8e08-0d321c9cd0ef" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e9ff9b-4683-412a-b1f6-a397c07d1b05]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:53 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef Nov 06 21:25:53 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:54 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef" returned: 0 in 0.728s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:54 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef Nov 06 21:25:54 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:54 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b157f4b-d055-43cb-8e08-0d321c9cd0ef" returned: 0 in 0.768s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Lock "cinder-quobyte-2b157f4b-d055-43cb-8e08-0d321c9cd0ef" released by "delete_volume" :: held 1.614s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Acquiring lock "cinder-quobyte-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Lock "cinder-quobyte-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[48157843-38e5-47e4-aa65-93bae9eb6f84]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:55 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb Nov 06 21:25:55 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:55 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb" returned: 0 in 0.954s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:56 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb Nov 06 21:25:56 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:56 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb" returned: 0 in 0.524s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Lock "cinder-quobyte-c2f5a500-6a7c-4cb5-a4c6-650e7c236eeb" released by "delete_volume" :: held 1.621s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:56 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Created reservations ['c76ecfa2-d681-4ecd-b9ca-f17542fb8bbd'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:56 devstack cinder-volume[87350]: WARNING cinder.quota [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2006631551 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2006631551, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:56 devstack cinder-volume[87350]: WARNING cinder.quota [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2006631551 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2006631551, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:56 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Created reservations ['b2fe04ad-7a24-48cc-8bda-6dd8b755b110', '1c689673-c170-490b-bc41-1845f7d1e858', '91057ff2-1fd2-40ae-97a3-95755cc3ece0', '9c0e3b63-3c17-4e26-be53-45c2021cb9ac'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Created reservations ['d09b8ebc-fb85-43b5-8bcf-97215d459827', 'bcc44ebe-87fa-4b0b-a8ae-520fc4423a2f', '82caa1da-4517-4ba3-8725-2c06d1ab8da8', 'd650e581-c157-47c9-b500-d05fa7ae39ad'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:57 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e" returned: 0 in 8.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65, size 1024.00 MB, duration 8.37 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:25:57 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Converted 1024.00 MB image at 122.32 MB/s Nov 06 21:25:57 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e is being set with open permissions: ugo+rw Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:57 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e Nov 06 21:25:57 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:57 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:57 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:57 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-061a3ca2-3e05-4c04-aba0-1326aec2e78e" released by "_copy_volume_from_snapshot" :: held 9.736s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-153d0e1b-5153-4692-bf6c-0e3435819987-061a3ca2-3e05-4c04-aba0-1326aec2e78e" released by "_create_volume_from_snapshot" :: held 9.913s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.840s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-779936376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0827434b-5f03-467d-888f-d348e446b4ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='57874f1c0d1e4933bbbda1701198cf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:25:48Z,use_quota=True,user_id='1c74101982d24443bbe49815370d6fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Creating volume 0827434b-5f03-467d-888f-d348e446b4ed {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:57 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:25:57 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.381s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d61896bc-067d-47dc-84a5-17d2a149e58d tempest-GroupsTest-460773422 None] Delete group completed successfully. Nov 06 21:25:57 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed 1073741824 Nov 06 21:25:57 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efc0381-0f92-4686-8407-3e20137b4fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e', 'volume_size': 1, 'snapshot_id': '153d0e1b-5153-4692-bf6c-0e3435819987'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb8cdb7-40b3-4ad0-b006-7cf7d467164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:57 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Volume volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e (061a3ca2-3e05-4c04-aba0-1326aec2e78e): created successfully Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb8cdb7-40b3-4ad0-b006-7cf7d467164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Flow 'volume_create_manager' (8df59b24-1edf-47a2-805c-d4aade8f6142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-74bc4d66-5ee2-4a16-aaec-807224b01637 tempest-VolumesSnapshotTestJSON-938610065 None] Created volume successfully. Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-061a3ca2-3e05-4c04-aba0-1326aec2e78e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-061a3ca2-3e05-4c04-aba0-1326aec2e78e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-061a3ca2-3e05-4c04-aba0-1326aec2e78e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:58 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed 1073741824" returned: 0 in 0.669s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-061a3ca2-3e05-4c04-aba0-1326aec2e78e" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a2c4b-6753-4ee2-8566-b1a300216834]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:58 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed Nov 06 21:25:58 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:58 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e Nov 06 21:25:58 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:58 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed" returned: 0 in 0.337s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af213164-77d6-475c-b136-4fd422b1d4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0827434b-5f03-467d-888f-d348e446b4ed', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea084317-a6d7-4623-a771-d5d1dd919041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:25:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Volume volume-0827434b-5f03-467d-888f-d348e446b4ed (0827434b-5f03-467d-888f-d348e446b4ed): created successfully Nov 06 21:25:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea084317-a6d7-4623-a771-d5d1dd919041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Flow 'volume_create_manager' (05797a87-22a2-4dd7-ae28-9740887628fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:25:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-53f71003-b88e-4f08-af20-1fd18f7bf5a8 tempest-VolumesListTestJSON-1077840043 None] Created volume successfully. Nov 06 21:25:59 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e" returned: 0 in 0.490s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:59 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e Nov 06 21:25:59 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:59 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-061a3ca2-3e05-4c04-aba0-1326aec2e78e" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-061a3ca2-3e05-4c04-aba0-1326aec2e78e" released by "delete_volume" :: held 0.847s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['0b346dd2-7bde-49c6-8a4f-7e192bff8ce0', 'b1535d3f-fb42-49b5-b7da-cf668b911f19', '2bb20a1e-a9b5-4d54-9eea-0d447ef0a016', 'a091763f-cdaf-4290-874a-7acd384e88af'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:59 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:25:59 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-153d0e1b-5153-4692-bf6c-0e3435819987-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-153d0e1b-5153-4692-bf6c-0e3435819987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-31635b11-5128-43b5-977f-fedae07dfc65" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-31635b11-5128-43b5-977f-fedae07dfc65" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-153d0e1b-5153-4692-bf6c-0e3435819987" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-153d0e1b-5153-4692-bf6c-0e3435819987" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Deleting offline snapshot 153d0e1b-5153-4692-bf6c-0e3435819987 of volume 31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] snapshot_file for this snap is: volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf67e5e-1884-45d9-8599-ce7115806451]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:25:59 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:25:59 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:25:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Deleted volume successfully. Nov 06 21:26:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5376879a-fc8b-4142-afc8-333a7fcef62e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-061a3ca2-3e05-4c04-aba0-1326aec2e78e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:00 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 Nov 06 21:26:00 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:00 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987" returned: 0 in 0.557s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31635b11-5128-43b5-977f-fedae07dfc65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:26:00 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[717a5ace-51ef-46d2-a5a7-1e36c22512c4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:00 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 Nov 06 21:26:00 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:01 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65" returned: 0 in 0.752s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:01 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 Nov 06 21:26:01 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:01 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987" returned: 0 in 0.469s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:01 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987 Nov 06 21:26:01 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:02 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65.153d0e1b-5153-4692-bf6c-0e3435819987" returned: 0 in 0.363s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-153d0e1b-5153-4692-bf6c-0e3435819987" released by "_delete_snapshot" :: held 2.348s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-31635b11-5128-43b5-977f-fedae07dfc65" released by "delete_snapshot" :: held 2.392s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:02 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['8f5e1ee0-dc54-41e9-bfb3-b8f1fa624381', '7fb6f294-822e-4288-aeef-889c101cbe08', 'dd1d1ed9-3fa6-4800-bdb8-9588151d99ac', 'a8840055-4522-4bd9-895f-a92ee32aea63'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Delete snapshot completed successfully. Nov 06 21:26:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e4fcf19c-5e1b-4f22-8b60-94a201bcad3e tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-153d0e1b-5153-4692-bf6c-0e3435819987-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-31635b11-5128-43b5-977f-fedae07dfc65-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-31635b11-5128-43b5-977f-fedae07dfc65-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-31635b11-5128-43b5-977f-fedae07dfc65" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-31635b11-5128-43b5-977f-fedae07dfc65" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fac70b-52fa-49b9-93d3-f9535d77be77]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "cinder-0827434b-5f03-467d-888f-d348e446b4ed-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-0827434b-5f03-467d-888f-d348e446b4ed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:03 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 Nov 06 21:26:03 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "cinder-quobyte-0827434b-5f03-467d-888f-d348e446b4ed" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-quobyte-0827434b-5f03-467d-888f-d348e446b4ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ebf4b-1ef3-4ae9-8d40-7a71b1222fbd]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed Nov 06 21:26:03 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:03 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65" returned: 0 in 0.481s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:03 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65 Nov 06 21:26:03 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed" returned: 0 in 0.523s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-31635b11-5128-43b5-977f-fedae07dfc65" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed Nov 06 21:26:04 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-31635b11-5128-43b5-977f-fedae07dfc65" released by "delete_volume" :: held 0.903s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['5a79123b-f91b-4554-95d4-376db8a92f22', '341e32b8-3a52-4310-aa75-581f274fee33', 'd804a045-eae7-4cf8-a8fa-3cec503fa253', '3f2568fb-4c84-4456-a1b2-c42590a6cccf'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:04 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0827434b-5f03-467d-888f-d348e446b4ed" returned: 0 in 0.320s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-quobyte-0827434b-5f03-467d-888f-d348e446b4ed" released by "delete_volume" :: held 0.910s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Created reservations ['1abf3ef5-49d9-4bba-a0d5-774269a58aac', '519fd067-59e0-4c03-9075-b212c4453045', '08adf647-3b7d-412b-8686-1b1759479aab', '19efd01f-1b1f-4dc3-9431-5c49a6bb9f4b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:04 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:04 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:04 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.342s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Deleted volume successfully. Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a07ed6d9-4629-4686-a6b4-35b801a9cb16 tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-31635b11-5128-43b5-977f-fedae07dfc65-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:04 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.278s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Deleted volume successfully. Nov 06 21:26:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1037d721-c793-4975-a19a-146ca9331c50 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-0827434b-5f03-467d-888f-d348e446b4ed-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-12bcad39-7c60-4864-ae7c-b244a4fa1bf8-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-12bcad39-7c60-4864-ae7c-b244a4fa1bf8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "cinder-quobyte-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb01f0b-0235-4f23-bd8d-32373f46b0dd]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "cinder-aa4c4fef-637d-45aa-bf41-ab6560201701-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:05 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 Nov 06 21:26:05 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-aa4c4fef-637d-45aa-bf41-ab6560201701-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "cinder-quobyte-aa4c4fef-637d-45aa-bf41-ab6560201701" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Flow 'volume_create_manager' (df6558d5-1f0e-464a-a4a1-cfe26c43129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1022a818-2112-4dfe-9da3-af62866ead2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-quobyte-aa4c4fef-637d-45aa-bf41-ab6560201701" acquired by "delete_volume" :: waited 0.061s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1022a818-2112-4dfe-9da3-af62866ead2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-606335938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ece4b42cae843a394f06276aadb5a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:06Z,use_quota=True,user_id='4a1097a5769d469b8337f17307755b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617a6bf3-4de2-4b4c-9c7c-1f74868885f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (617a6bf3-4de2-4b4c-9c7c-1f74868885f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bd33fe-9a2d-4647-b301-f284164294ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bd33fe-9a2d-4647-b301-f284164294ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f', 'volume_name': 'volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0447dd09-d846-4852-8b44-01719534c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0447dd09-d846-4852-8b44-01719534c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db32410-73c5-416d-853b-7f5a93a3b926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:06 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Volume 4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f', 'volume_size': 1} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-606335938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ece4b42cae843a394f06276aadb5a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:06Z,use_quota=True,user_id='4a1097a5769d469b8337f17307755b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Creating volume 4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:06 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6267b9-8928-474a-955a-6818f5965a7d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f 1073741824 Nov 06 21:26:06 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" returned: 0 in 0.502s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8 Nov 06 21:26:06 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 Nov 06 21:26:06 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" returned: 0 in 0.341s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-quobyte-12bcad39-7c60-4864-ae7c-b244a4fa1bf8" released by "delete_volume" :: held 0.949s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Created reservations ['17b9a0b1-9208-4aac-a9cb-81a174045c37', '133dcc7e-e172-4e36-9496-624598b15541', '50b96be6-5346-48d6-8d44-dd05065a7acf', 'bd8931f5-63a8-4f34-b686-8552c08f6fec'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:06 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701" returned: 0 in 0.531s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701 Nov 06 21:26:06 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f 1073741824" returned: 0 in 0.688s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:06 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:06 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:06 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f Nov 06 21:26:06 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:06 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aa4c4fef-637d-45aa-bf41-ab6560201701" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-quobyte-aa4c4fef-637d-45aa-bf41-ab6560201701" released by "delete_volume" :: held 1.059s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Created reservations ['45082dda-650d-4e08-9bb0-6157dbdcc53a', '1ee91f5a-5613-4b8b-86c4-1bbae8215b74', 'a389e4f6-bb4b-4dd4-952b-9c323125eac1', 'a53b607f-93b1-4950-9684-d004e3d4bf8b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:07 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.401s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Deleted volume successfully. Nov 06 21:26:07 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db32410-73c5-416d-853b-7f5a93a3b926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a702713f-36e4-4d6d-abfc-639ffcdb4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df21c98f-a868-40ec-907d-0a70612d2ddd tempest-VolumesSnapshotTestJSON-938610065 None] Lock "cinder-12bcad39-7c60-4864-ae7c-b244a4fa1bf8-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Volume volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f (4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f): created successfully Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a702713f-36e4-4d6d-abfc-639ffcdb4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:07 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Flow 'volume_create_manager' (df6558d5-1f0e-464a-a4a1-cfe26c43129f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:07 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d08d3c1e-0c9c-4929-b897-efb8f2380a21 tempest-GroupsV320Test-60064471 None] Group tempest-GroupsV320Test-Group-1646389649: creating Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ec25e1bd-dd03-4c28-a142-b0a83a19b3e6 tempest-TestStampPattern-1838259923 None] Created volume successfully. Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=218,cinder:SELECT=187,cinder:INSERT=56,cinder:DELETE=15 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d08d3c1e-0c9c-4929-b897-efb8f2380a21 tempest-GroupsV320Test-60064471 None] Group tempest-GroupsV320Test-Group-1646389649: created successfully Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d08d3c1e-0c9c-4929-b897-efb8f2380a21 tempest-GroupsV320Test-60064471 None] Create group completed successfully. Nov 06 21:26:07 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.262s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Deleted volume successfully. Nov 06 21:26:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-91d98df9-9143-4d81-b683-85933fe4dc9c tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-aa4c4fef-637d-45aa-bf41-ab6560201701-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "cinder-0f074960-b544-43e6-a877-8a43d5d2ad87-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-0f074960-b544-43e6-a877-8a43d5d2ad87-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=177,cinder:INSERT=64,cinder:UPDATE=234,cinder:DELETE=16 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "cinder-quobyte-0f074960-b544-43e6-a877-8a43d5d2ad87" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-quobyte-0f074960-b544-43e6-a877-8a43d5d2ad87" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5853a9-c762-4969-93ab-cec48cf58b22]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:08 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 Nov 06 21:26:08 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:08 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87" returned: 0 in 0.565s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:08 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87 Nov 06 21:26:08 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Created reservations ['6970dfac-c3ab-4560-9504-fdbc90db0fab'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:09 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:09 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:09 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0f074960-b544-43e6-a877-8a43d5d2ad87" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-quobyte-0f074960-b544-43e6-a877-8a43d5d2ad87" released by "delete_volume" :: held 1.020s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Created reservations ['bc53bcee-3762-4afc-82d5-9545ab7d64bd', '2330fdea-360d-4003-b055-932e00ba0575', '82f61dfd-b470-412f-a27b-3b234088b911', 'cf44552d-3118-49eb-abfe-bce234eae0bc'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:09 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.435s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-fdb078d9-59eb-4617-987e-5e044590b435 tempest-GroupsV320Test-60064471 None] Delete group completed successfully. Nov 06 21:26:09 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:09 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:09 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.350s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Deleted volume successfully. Nov 06 21:26:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9cf56efc-b2d1-4837-b2c6-76cf17c2d5b6 tempest-VolumesListTestJSON-1077840043 None] Lock "cinder-0f074960-b544-43e6-a877-8a43d5d2ad87-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Flow 'volume_create_manager' (b403e249-010a-4ab4-87ea-8fb0590ef464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15070a88-de22-42f7-9532-76b1b8a3cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15070a88-de22-42f7-9532-76b1b8a3cde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-56098565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9caee80-c3a6-48bd-9d91-f427b77b7c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b06ac915b9a4d2db9dded76ffc54317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:18Z,use_quota=True,user_id='d7f0053180cd499b80f145d7ca068880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd4d518-bbcb-40b7-b1ee-0ec03a91e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd4d518-bbcb-40b7-b1ee-0ec03a91e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4556f0bf-5d95-459d-a166-ac73d4ffa1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4556f0bf-5d95-459d-a166-ac73d4ffa1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9caee80-c3a6-48bd-9d91-f427b77b7c3e', 'volume_name': 'volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79d51aa-5411-4411-b0f0-019aac347feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79d51aa-5411-4411-b0f0-019aac347feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcaa950-2b02-4b80-a0e0-534855d6c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:17 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Volume e9caee80-c3a6-48bd-9d91-f427b77b7c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e', 'volume_size': 1} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-56098565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9caee80-c3a6-48bd-9d91-f427b77b7c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b06ac915b9a4d2db9dded76ffc54317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:18Z,use_quota=True,user_id='d7f0053180cd499b80f145d7ca068880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Creating volume e9caee80-c3a6-48bd-9d91-f427b77b7c3e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:17 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:26:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:17 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e 1073741824 Nov 06 21:26:17 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:18 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e 1073741824" returned: 0 in 0.644s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:18 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e Nov 06 21:26:18 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:19 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e" returned: 0 in 0.578s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcaa950-2b02-4b80-a0e0-534855d6c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9787e61f-5910-45ce-9253-9750d5e3f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:19 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Volume volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e (e9caee80-c3a6-48bd-9d91-f427b77b7c3e): created successfully Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9787e61f-5910-45ce-9253-9750d5e3f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Flow 'volume_create_manager' (b403e249-010a-4ab4-87ea-8fb0590ef464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5fa966a4-8679-4b54-8437-2f9400c19ef8 tempest-VolumesNegativeTest-2045692489 None] Created volume successfully. Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Flow 'volume_create_manager' (d07df863-da8a-4267-a76e-0ea76deb5852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039cca63-571b-4745-8cc8-ab98b1b69287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039cca63-571b-4745-8cc8-ab98b1b69287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1063738069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4e9fe5-a5f0-49cf-88ac-794788ac012a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9bdbcf80849e59456467297e7ad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:22Z,use_quota=True,user_id='e9a3b6202a904527a9fafeab91d1b11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65177efd-d210-44d7-8999-a48c8c197307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65177efd-d210-44d7-8999-a48c8c197307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226dc8f1-3858-43e6-a9fe-e2f1402787a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226dc8f1-3858-43e6-a9fe-e2f1402787a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4e9fe5-a5f0-49cf-88ac-794788ac012a', 'volume_name': 'volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a', 'volume_size': 2}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d16cc8-8dfb-4eb8-a24d-73281f0fcd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d16cc8-8dfb-4eb8-a24d-73281f0fcd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e59395d-14c7-4eed-af80-611c9a9aa93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:21 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Volume fc4e9fe5-a5f0-49cf-88ac-794788ac012a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a', 'volume_size': 2} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1063738069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4e9fe5-a5f0-49cf-88ac-794788ac012a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9bdbcf80849e59456467297e7ad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:22Z,use_quota=True,user_id='e9a3b6202a904527a9fafeab91d1b11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Creating volume fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:22 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:26:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a 2147483648 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:22 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a 2147483648 Nov 06 21:26:22 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a 2147483648" returned: 0 in 1.095s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:23 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a Nov 06 21:26:23 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:23 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" returned: 0 in 0.758s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e59395d-14c7-4eed-af80-611c9a9aa93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a', 'volume_size': 2}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edad3b32-391c-40f8-af14-3277a1ac505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:24 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Volume volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a (fc4e9fe5-a5f0-49cf-88ac-794788ac012a): created successfully Nov 06 21:26:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edad3b32-391c-40f8-af14-3277a1ac505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Flow 'volume_create_manager' (d07df863-da8a-4267-a76e-0ea76deb5852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:24 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d8e4aea1-cc48-463e-8e7c-a3e29736cc43 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Created volume successfully. Nov 06 21:26:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Creating offline snapshot 60886586-227a-4969-8e3d-0e64da549267 of volume fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:26:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300b8aa-6256-4424-b857-30226466276f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:25 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a Nov 06 21:26:25 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" returned: 0 in 0.565s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 2G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:26 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 2G Nov 06 21:26:26 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:26 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 2G" returned: 0 in 0.607s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:26 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 Nov 06 21:26:26 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:27 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267" returned: 0 in 0.491s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:27 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 is being set with open permissions: ugo+rw Nov 06 21:26:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:27 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 Nov 06 21:26:27 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:27 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267" returned: 0 in 0.384s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:27 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info Nov 06 21:26:27 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info" returned: 0 in 0.358s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:28 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info is being set with open permissions: ugo+rw Nov 06 21:26:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:28 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info Nov 06 21:26:28 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:28 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.info" returned: 0 in 0.402s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ac81cd83-4035-4669-a54b-ff636947948e tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Create snapshot completed successfully Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "cinder-60886586-227a-4969-8e3d-0e64da549267-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-60886586-227a-4969-8e3d-0e64da549267-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "cinder-quobyte-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-quobyte-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "cinder-quobyte-60886586-227a-4969-8e3d-0e64da549267" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-quobyte-60886586-227a-4969-8e3d-0e64da549267" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Deleting offline snapshot 60886586-227a-4969-8e3d-0e64da549267 of volume fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] snapshot_file for this snap is: volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[953cb34e-cbc1-4f07-b496-208f16d40024]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:29 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 Nov 06 21:26:29 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:30 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267" returned: 0 in 0.697s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:26:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a000d61-7857-4e0f-90cd-4ee11f61e722]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:30 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a Nov 06 21:26:30 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:30 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" returned: 0 in 0.511s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:30 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 Nov 06 21:26:30 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:31 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267" returned: 0 in 0.476s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:31 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267 Nov 06 21:26:31 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:31 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a.60886586-227a-4969-8e3d-0e64da549267" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-quobyte-60886586-227a-4969-8e3d-0e64da549267" released by "_delete_snapshot" :: held 2.185s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-quobyte-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" released by "delete_snapshot" :: held 2.213s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Created reservations ['33954506-80ca-487b-b23b-3163604b43f7', '499b0d9f-538f-4eae-975c-7226de62c473', '4896c50c-1c10-4fed-8991-95aabeaef599', 'cd530278-7c41-4639-ae3f-3dd7a0cd2a07'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Delete snapshot completed successfully. Nov 06 21:26:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f38b40ec-66e6-4d21-8b41-18ef892cc4ed tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-60886586-227a-4969-8e3d-0e64da549267-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:32 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:32 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:32 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.315s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "cinder-fc4e9fe5-a5f0-49cf-88ac-794788ac012a-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-fc4e9fe5-a5f0-49cf-88ac-794788ac012a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "cinder-quobyte-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-quobyte-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[47202411-877f-49ae-b0ff-6d8ad74ca3e1]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:33 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a Nov 06 21:26:33 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:33 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" returned: 0 in 0.540s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:33 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a Nov 06 21:26:33 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:33 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-quobyte-fc4e9fe5-a5f0-49cf-88ac-794788ac012a" released by "delete_volume" :: held 0.986s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Created reservations ['955ba8af-277c-4761-a8c5-f6a5743a102f', '9620daf3-4e2d-4abd-8a83-5951a9f5c368', 'e1303de4-5bc6-41c3-b0f7-0a9089bbca3c', 'ee82911d-5a0a-4e91-a5b6-a8e8d41d0920'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:34 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:34 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:34 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Deleted volume successfully. Nov 06 21:26:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-627370d5-bfdd-4141-8ee2-32c349d9c8e7 tempest-VolumesSnapshotNegativeTestJSON-1275012286 None] Lock "cinder-fc4e9fe5-a5f0-49cf-88ac-794788ac012a-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Flow 'volume_create_manager' (9a8b22a2-9da7-4cd0-81d3-3fb174fe4893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108401ae-8a32-444f-8dec-f58e5c388691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108401ae-8a32-444f-8dec-f58e5c388691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1658546698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff6791-06cb-43bb-8be8-cdc8eb6c3068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d9e50c11c14732a2a74a177386df2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:43Z,use_quota=True,user_id='11cfb5c2c57c466cbaa93f9928e91dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480cc482-ea26-417a-bd18-628fd82f0687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480cc482-ea26-417a-bd18-628fd82f0687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6e0585-bcb1-4b7e-abc0-8df61bc23a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6e0585-bcb1-4b7e-abc0-8df61bc23a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ff6791-06cb-43bb-8be8-cdc8eb6c3068', 'volume_name': 'volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfb63cb-6ea0-40c4-bd5c-ad870c36acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfb63cb-6ea0-40c4-bd5c-ad870c36acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3458bb87-b238-4a39-b81a-d570a80ed49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Volume 37ff6791-06cb-43bb-8be8-cdc8eb6c3068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068', 'volume_size': 1} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1658546698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff6791-06cb-43bb-8be8-cdc8eb6c3068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d9e50c11c14732a2a74a177386df2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:43Z,use_quota=True,user_id='11cfb5c2c57c466cbaa93f9928e91dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Creating volume 37ff6791-06cb-43bb-8be8-cdc8eb6c3068 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:43 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:43 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 1073741824 Nov 06 21:26:43 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-450eab59-80ee-4107-aa26-7c81287916cf req-be7f1473-3dd7-4508-9c01-0b452b779544 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:44 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 1073741824" returned: 0 in 0.686s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:44 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 Nov 06 21:26:44 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:44 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-450eab59-80ee-4107-aa26-7c81287916cf req-be7f1473-3dd7-4508-9c01-0b452b779544 tempest-TestStampPattern-1838259923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.567s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3458bb87-b238-4a39-b81a-d570a80ed49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7458a3-0a70-481c-9057-a8f019b02713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-450eab59-80ee-4107-aa26-7c81287916cf req-be7f1473-3dd7-4508-9c01-0b452b779544 tempest-TestStampPattern-1838259923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:44 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Volume volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 (37ff6791-06cb-43bb-8be8-cdc8eb6c3068): created successfully Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7458a3-0a70-481c-9057-a8f019b02713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Flow 'volume_create_manager' (9a8b22a2-9da7-4cd0-81d3-3fb174fe4893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-450eab59-80ee-4107-aa26-7c81287916cf req-be7f1473-3dd7-4508-9c01-0b452b779544 tempest-TestStampPattern-1838259923 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab11b893-8fac-4bd5-9c95-2e61876753a1', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:26:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d6740513-5a68-4378-9e6e-8fb7bc55a988 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Created volume successfully. Nov 06 21:26:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-450eab59-80ee-4107-aa26-7c81287916cf req-be7f1473-3dd7-4508-9c01-0b452b779544 tempest-TestStampPattern-1838259923 None] attachment_update completed successfully. Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Acquiring lock "cinder-e9caee80-c3a6-48bd-9d91-f427b77b7c3e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Lock "cinder-e9caee80-c3a6-48bd-9d91-f427b77b7c3e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Acquiring lock "cinder-quobyte-e9caee80-c3a6-48bd-9d91-f427b77b7c3e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Lock "cinder-quobyte-e9caee80-c3a6-48bd-9d91-f427b77b7c3e" acquired by "delete_volume" :: waited 0.045s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51db21-20a9-4d1f-9c9e-79ddb18a58ff]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:45 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e Nov 06 21:26:45 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "cinder-37ff6791-06cb-43bb-8be8-cdc8eb6c3068-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "cinder-37ff6791-06cb-43bb-8be8-cdc8eb6c3068-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "cinder-quobyte-37ff6791-06cb-43bb-8be8-cdc8eb6c3068" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "cinder-quobyte-37ff6791-06cb-43bb-8be8-cdc8eb6c3068" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3eec9-2b8d-481a-91dd-6e8e895a0c1b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:45 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e" returned: 0 in 0.630s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:45 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e Nov 06 21:26:45 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:45 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 Nov 06 21:26:45 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:45 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e9caee80-c3a6-48bd-9d91-f427b77b7c3e" returned: 0 in 0.318s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Lock "cinder-quobyte-e9caee80-c3a6-48bd-9d91-f427b77b7c3e" released by "delete_volume" :: held 1.029s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Created reservations ['672d839c-170c-40d7-a870-b79e79635327', 'd415d80b-0d74-4dc3-b006-747bf7b177c2', '8934e31d-2310-46d3-9b18-cd754b1fc014', '944812c1-5ee7-4ed9-8a6e-810dbc6bc257'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:46 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:46 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068 Nov 06 21:26:46 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:46 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:46 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:46 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-37ff6791-06cb-43bb-8be8-cdc8eb6c3068" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "cinder-quobyte-37ff6791-06cb-43bb-8be8-cdc8eb6c3068" released by "delete_volume" :: held 0.868s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:46 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.281s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Deleted volume successfully. Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e5febd25-6408-444b-b091-2cbcc6566a18 tempest-VolumesNegativeTest-2045692489 None] Lock "cinder-e9caee80-c3a6-48bd-9d91-f427b77b7c3e-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Created reservations ['b0481826-11ff-472f-9bfe-84485050efd3', 'b17e36af-525f-40c5-a106-48fffb8198da', '4a8d8919-c95d-48c2-a68d-77ffa725b71e', '9ea442ae-b76e-4811-9d82-c33853e91a12'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:46 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:46 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:46 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.336s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Deleted volume successfully. Nov 06 21:26:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f58e821-aed3-46af-afdf-c45b7c7cd689 tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "cinder-37ff6791-06cb-43bb-8be8-cdc8eb6c3068-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Flow 'volume_create_manager' (d35aa7b8-49a5-4f1f-8794-362a084cb957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ee0dad-b19e-4650-a23d-cf1a9ca2c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ee0dad-b19e-4650-a23d-cf1a9ca2c565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-594957275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580ac542-ba57-415c-9ed5-8fbf5ab1f8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d9e50c11c14732a2a74a177386df2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:47Z,use_quota=True,user_id='11cfb5c2c57c466cbaa93f9928e91dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4524fce-5e45-43ba-9d96-f73ce5917505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4524fce-5e45-43ba-9d96-f73ce5917505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3ad49c-7d25-4608-a109-5b00f91c76c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3ad49c-7d25-4608-a109-5b00f91c76c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580ac542-ba57-415c-9ed5-8fbf5ab1f8b1', 'volume_name': 'volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3b5279-d688-4bff-8b99-c87274bb059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3b5279-d688-4bff-8b99-c87274bb059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9424fd3b-ac47-4fff-a91e-ffa19072efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Volume 580ac542-ba57-415c-9ed5-8fbf5ab1f8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1', 'volume_size': 1} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-594957275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580ac542-ba57-415c-9ed5-8fbf5ab1f8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d9e50c11c14732a2a74a177386df2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:47Z,use_quota=True,user_id='11cfb5c2c57c466cbaa93f9928e91dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Creating volume 580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:47 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:26:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:47 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 1073741824 Nov 06 21:26:47 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:48 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 1073741824" returned: 0 in 0.660s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:48 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 Nov 06 21:26:48 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:48 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1" returned: 0 in 0.341s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9424fd3b-ac47-4fff-a91e-ffa19072efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8868cc8-b555-4385-9c0b-4b9e32b7ef86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:48 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Volume volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 (580ac542-ba57-415c-9ed5-8fbf5ab1f8b1): created successfully Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8868cc8-b555-4385-9c0b-4b9e32b7ef86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Flow 'volume_create_manager' (d35aa7b8-49a5-4f1f-8794-362a084cb957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2cbee91c-6bd7-404a-8342-d9395f8ee63c tempest-VolumeQuotasAdminTestJSON-1989621115 None] Created volume successfully. Nov 06 21:26:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a83c88c4-bbe1-4f41-bdf3-dc334d836e9f tempest-VolumeQuotasAdminTestJSON-366894515 None] Transfer volume completed successfully. Nov 06 21:26:51 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-f2989783-9757-4222-8886-18d1ad925933 req-a7cb6cd1-0efe-4778-bf7e-0742711b37d0 tempest-TestStampPattern-1838259923 None] Terminate volume connection completed successfully. Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-f2989783-9757-4222-8886-18d1ad925933 req-a7cb6cd1-0efe-4778-bf7e-0742711b37d0 tempest-TestStampPattern-1838259923 None] Deleting attachment ab11b893-8fac-4bd5-9c95-2e61876753a1. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Acquiring lock "cinder-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Lock "cinder-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Acquiring lock "cinder-quobyte-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Lock "cinder-quobyte-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3e72c6-a7fc-491d-904f-62ff0e54fcbd]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:52 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 Nov 06 21:26:52 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Flow 'volume_create_manager' (b36c6afa-ed2e-4d73-8714-0331ca9cbdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:52 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf328c61-768d-451e-9a41-b1f41d7815fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1" returned: 0 in 0.603s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:52 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1 Nov 06 21:26:52 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf328c61-768d-451e-9a41-b1f41d7815fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-145943515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddbc45c-960d-4e4f-a2f9-e63b61365f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560de10f222a47a684386ec8d71ade32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:52Z,use_quota=True,user_id='65bde929dfee409fb9fbfb96b5b78712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f01f27c-610e-4d78-a75f-e05a861be877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f01f27c-610e-4d78-a75f-e05a861be877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17937328-f719-456e-815c-d4678ff33000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17937328-f719-456e-815c-d4678ff33000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddbc45c-960d-4e4f-a2f9-e63b61365f56', 'volume_name': 'volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffa3206-7cc7-46eb-a8c9-cc9b8465b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffa3206-7cc7-46eb-a8c9-cc9b8465b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c9cf5f-eb4e-4841-b988-6b7ed78b1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Volume eddbc45c-960d-4e4f-a2f9-e63b61365f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56', 'volume_size': 1} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Creating offline snapshot 8bcac80e-127d-41a0-a38c-0511e45e16c0 of volume 4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a638678b-5063-42eb-880a-0d755556e4de]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:52 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f Nov 06 21:26:52 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:52 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1" returned: 0 in 0.339s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Lock "cinder-quobyte-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1" released by "delete_volume" :: held 1.017s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:52 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Created reservations ['69170802-006d-42f0-8d46-545b2e26cadc', '59d4e73a-8a93-4218-878a-be5c47f00565', '43ff0a44-545e-4831-adf6-d155ebb6c46a', 'db64f4d6-572e-44c9-a834-fb25a6b9f6cc'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:53 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:26:53 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:53 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" returned: 0 in 0.595s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:53 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 1G Nov 06 21:26:53 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:53 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.323s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:26:53 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Deleted volume successfully. Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-97f8eb63-4617-48dd-887a-c5944045bc30 tempest-VolumeQuotasAdminTestJSON-1870962706 None] Lock "cinder-580ac542-ba57-415c-9ed5-8fbf5ab1f8b1-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:26:53 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 1G" returned: 0 in 0.570s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:53 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 Nov 06 21:26:53 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:54 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0" returned: 0 in 0.390s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:54 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 is being set with open permissions: ugo+rw Nov 06 21:26:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:54 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 Nov 06 21:26:54 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:54 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0" returned: 0 in 0.299s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:54 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info Nov 06 21:26:54 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:54 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:54 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info is being set with open permissions: ugo+rw Nov 06 21:26:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:54 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info Nov 06 21:26:54 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:55 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.info" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.594s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-145943515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddbc45c-960d-4e4f-a2f9-e63b61365f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560de10f222a47a684386ec8d71ade32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:26:52Z,use_quota=True,user_id='65bde929dfee409fb9fbfb96b5b78712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Creating volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:26:55 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:55 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 1073741824 Nov 06 21:26:55 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-36e389ec-1d9a-4695-bb7a-5f87ecdd225c tempest-TestStampPattern-1838259923 None] Create snapshot completed successfully Nov 06 21:26:55 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 1073741824" returned: 0 in 0.696s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:55 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 Nov 06 21:26:55 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:56 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56" returned: 0 in 0.302s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c9cf5f-eb4e-4841-b988-6b7ed78b1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6ed229-b58c-44a9-a7a0-52d8f079b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:26:56 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Volume volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 (eddbc45c-960d-4e4f-a2f9-e63b61365f56): created successfully Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6ed229-b58c-44a9-a7a0-52d8f079b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Flow 'volume_create_manager' (b36c6afa-ed2e-4d73-8714-0331ca9cbdf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:26:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-34baca2d-3f46-4321-96bf-fd80af056896 tempest-VolumesSnapshotListTestJSON-1610704609 None] Created volume successfully. Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Creating offline snapshot 7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 of volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6ff26-929f-4732-b6d1-a9dc6f9cd8c2]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:26:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:57 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 Nov 06 21:26:57 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:57 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56" returned: 0 in 0.516s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:57 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 1G Nov 06 21:26:57 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:57 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 1G" returned: 0 in 0.595s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:58 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:26:58 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:58 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 0.464s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:58 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 is being set with open permissions: ugo+rw Nov 06 21:26:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:58 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:26:58 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:58 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:58 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info Nov 06 21:26:58 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:59 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:59 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info is being set with open permissions: ugo+rw Nov 06 21:26:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:26:59 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info Nov 06 21:26:59 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:26:59 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 06 21:26:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.info" returned: 0 in 0.300s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:26:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:26:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-be2b4c0b-58e2-4ef3-b0e8-9516c28bde38 tempest-VolumesSnapshotListTestJSON-1610704609 None] Create snapshot completed successfully Nov 06 21:27:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Creating offline snapshot 5f81633f-6cfe-4c11-aa27-5e99e112d089 of volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:00 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4da941d-079f-48bc-beb0-9e07c525bf32]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:00 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:27:00 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:01 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 0.657s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:01 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 1G Nov 06 21:27:01 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:01 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 1G" returned: 0 in 0.687s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:01 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:01 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:02 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:02 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 is being set with open permissions: ugo+rw Nov 06 21:27:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:02 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:02 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:02 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 0.325s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e7292d0f-2862-4c53-8dbf-b8630970b34a tempest-VolumesSnapshotListTestJSON-1610704609 None] Create snapshot completed successfully Nov 06 21:27:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Creating offline snapshot 8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 of volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:27:03 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0821c2-7c6b-4e3e-b01c-55f7045e3ce8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:03 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:03 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:04 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 0.447s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:04 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 1G Nov 06 21:27:04 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 1G" returned: 0 in 0.794s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 Nov 06 21:27:05 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Flow 'volume_create_manager' (0d063a7d-a1e5-45aa-b4de-8cb877d17604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5917a01-79fb-42e9-9610-38f3cef8635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5917a01-79fb-42e9-9610-38f3cef8635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1586469533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee5f9e6-7b79-47e2-bd28-42879807ff28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ece4b42cae843a394f06276aadb5a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8bcac80e-127d-41a0-a38c-0511e45e16c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:05Z,use_quota=True,user_id='4a1097a5769d469b8337f17307755b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29ac86c-ca74-4270-b802-e3c29e02e4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29ac86c-ca74-4270-b802-e3c29e02e4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096ed91e-55ad-4956-b949-fe5255405739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096ed91e-55ad-4956-b949-fe5255405739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cee5f9e6-7b79-47e2-bd28-42879807ff28', 'volume_name': 'volume-cee5f9e6-7b79-47e2-bd28-42879807ff28', 'volume_size': 1, 'snapshot_id': '8bcac80e-127d-41a0-a38c-0511e45e16c0'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eb7aa6-36e0-4212-a13f-8fb46686459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eb7aa6-36e0-4212-a13f-8fb46686459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0a53e9-84b1-44d2-93a9-02979586ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:05 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Volume cee5f9e6-7b79-47e2-bd28-42879807ff28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cee5f9e6-7b79-47e2-bd28-42879807ff28', 'volume_size': 1, 'snapshot_id': '8bcac80e-127d-41a0-a38c-0511e45e16c0'} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:05 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" returned: 0 in 0.523s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 is being set with open permissions: ugo+rw Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:05 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 Nov 06 21:27:05 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:05 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" returned: 0 in 0.346s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.590s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-quobyte-8bcac80e-127d-41a0-a38c-0511e45e16c0-cee5f9e6-7b79-47e2-bd28-42879807ff28" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-8bcac80e-127d-41a0-a38c-0511e45e16c0-cee5f9e6-7b79-47e2-bd28-42879807ff28" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Creating volume cee5f9e6-7b79-47e2-bd28-42879807ff28 from snapshot 8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-quobyte-cee5f9e6-7b79-47e2-bd28-42879807ff28" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:06 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b64921cf-f335-4f57-80f1-9b965381b7a8 tempest-VolumesSnapshotListTestJSON-1610704609 None] Create snapshot completed successfully Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-cee5f9e6-7b79-47e2-bd28-42879807ff28" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] snapshot: 8bcac80e-127d-41a0-a38c-0511e45e16c0, volume: cee5f9e6-7b79-47e2-bd28-42879807ff28, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da6c9d-1a12-4e06-96be-dcca41170312]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 Nov 06 21:27:06 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:06 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0" returned: 0 in 0.427s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d6fa7-5e90-4fd1-8d6a-1f9a24268889]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:06 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f Nov 06 21:27:06 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:07 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" returned: 0 in 0.479s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:27:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:27:07 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:27:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:07 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 Nov 06 21:27:07 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-8a3fa70a-21ec-41c4-8c44-8c08b39d6d32-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-8a3fa70a-21ec-41c4-8c44-8c08b39d6d32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Deleting offline snapshot 8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 of volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] snapshot_file for this snap is: volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7772d657-a562-4e5c-89a3-612db800837e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:09 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 Nov 06 21:27:09 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:10 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" returned: 0 in 0.948s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:10 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e0d85d-abd4-4fe8-9dc8-1b5e4cdd34f2]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:10 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:10 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:11 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 1.141s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:11 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 Nov 06 21:27:11 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:12 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" returned: 0 in 1.537s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:12 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32 Nov 06 21:27:12 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:13 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" returned: 0 in 0.876s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-8a3fa70a-21ec-41c4-8c44-8c08b39d6d32" released by "_delete_snapshot" :: held 4.792s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" released by "delete_snapshot" :: held 4.864s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:13 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=79,cinder:UPDATE=74,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:13 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:DELETE=10,cinder:UPDATE=70,cinder:SELECT=65,cinder:INSERT=19 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Created reservations ['abc10563-5321-4ab8-a015-9c3fa9652f8a', '2ca8f4d8-fe76-4d5f-a441-2a94f276d3e1', '5c691c8d-3315-4193-badc-6c62fd4b45db', '0fac9fad-40e6-476b-b346-1b984aef875a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Delete snapshot completed successfully. Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-531e6f32-be0e-4ebb-860e-5fbc444bc38a tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-8a3fa70a-21ec-41c4-8c44-8c08b39d6d32-delete_snapshot" released by "delete_snapshot" :: held 5.350s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-5f81633f-6cfe-4c11-aa27-5e99e112d089-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-5f81633f-6cfe-4c11-aa27-5e99e112d089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-5f81633f-6cfe-4c11-aa27-5e99e112d089" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-5f81633f-6cfe-4c11-aa27-5e99e112d089" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Deleting offline snapshot 5f81633f-6cfe-4c11-aa27-5e99e112d089 of volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] snapshot_file for this snap is: volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:15 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764fda5-b695-4955-b2a8-8b3b77d95720]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:15 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:15 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:16 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 1.393s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:16 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b727c-e3e0-4f6e-9dea-fd8d56e54a59]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:16 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:27:16 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:17 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 1.236s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:17 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:17 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28" returned: 0 in 11.660s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f, size 1024.00 MB, duration 11.66 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:18 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Converted 1024.00 MB image at 87.80 MB/s Nov 06 21:27:18 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 is being set with open permissions: ugo+rw Nov 06 21:27:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 Nov 06 21:27:18 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:18 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 1.025s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:18 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089 Nov 06 21:27:18 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Flow 'volume_create_manager' (7237ba53-2d52-42ea-8a63-f0fe8bda42b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a11e755-b159-4e54-b8f7-f09d09e83f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a11e755-b159-4e54-b8f7-f09d09e83f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-346215095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017d2a13-16c5-4248-80ee-01f39a25ea63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42d3ce5911a4e638e8eb944d6986f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:19Z,use_quota=True,user_id='1e0920f4043f42cf9fcd5a90520ea355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86868c91-53db-4e73-a7d6-d096d81121a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86868c91-53db-4e73-a7d6-d096d81121a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c50dccb-f25f-45b6-9d57-34ba13e849cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28" returned: 0 in 0.486s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-cee5f9e6-7b79-47e2-bd28-42879807ff28" released by "_copy_volume_from_snapshot" :: held 13.173s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:19 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.5f81633f-6cfe-4c11-aa27-5e99e112d089" returned: 0 in 0.410s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-5f81633f-6cfe-4c11-aa27-5e99e112d089" released by "_delete_snapshot" :: held 4.352s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" released by "delete_snapshot" :: held 4.438s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-8bcac80e-127d-41a0-a38c-0511e45e16c0-cee5f9e6-7b79-47e2-bd28-42879807ff28" released by "_create_volume_from_snapshot" :: held 13.335s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.367s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0a53e9-84b1-44d2-93a9-02979586ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee5f9e6-7b79-47e2-bd28-42879807ff28', 'volume_size': 1, 'snapshot_id': '8bcac80e-127d-41a0-a38c-0511e45e16c0'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca22dfcd-e68f-46da-99c9-572d828bcf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Volume volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 (cee5f9e6-7b79-47e2-bd28-42879807ff28): created successfully Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca22dfcd-e68f-46da-99c9-572d828bcf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Flow 'volume_create_manager' (0d063a7d-a1e5-45aa-b4de-8cb877d17604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Created reservations ['46b35831-48e6-423b-ab3b-58a9fc053e83', 'd2125650-a351-4de0-9b19-6c57fd74cd86', 'e75f68cf-fb1c-46b4-93e3-e95e30b29e0c', 'aa2a8875-78b0-49ef-9aa3-32ba565d1b9d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-459bdd93-a70d-44dd-91a2-96a1c609f8c1 tempest-TestStampPattern-1838259923 None] Created volume successfully. Nov 06 21:27:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Delete snapshot completed successfully. Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ed1d7a83-1fb2-4b6b-a727-a47f7276bd4b tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-5f81633f-6cfe-4c11-aa27-5e99e112d089-delete_snapshot" released by "delete_snapshot" :: held 4.781s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c50dccb-f25f-45b6-9d57-34ba13e849cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '017d2a13-16c5-4248-80ee-01f39a25ea63', 'volume_name': 'volume-017d2a13-16c5-4248-80ee-01f39a25ea63', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0198ea6c-858e-4d64-931f-3b52d806c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0198ea6c-858e-4d64-931f-3b52d806c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1eebba4-30a6-46ac-9502-00999fd4ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:19 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Volume 017d2a13-16c5-4248-80ee-01f39a25ea63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-017d2a13-16c5-4248-80ee-01f39a25ea63', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:27:19 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Trying to clone 017d2a13-16c5-4248-80ee-01f39a25ea63 from image 0758c1e7-1e10-4850-a7cc-546025b05acd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:27:20 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b77e68d-17b6-4ada-82fb-0fb8b9cfaa2b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:20 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD Nov 06 21:27:20 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-7ee6a92e-94d4-42dc-bbf2-ee3e1a702672-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-7ee6a92e-94d4-42dc-bbf2-ee3e1a702672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Deleting offline snapshot 7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 of volume eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] snapshot_file for this snap is: volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f224b01c-74ec-45f3-84b5-b3f008e4d41d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:20 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD" returned: 0 in 0.585s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:20 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd is fetched for user 1e0920f4043f42cf9fcd5a90520ea355. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:27:20 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:27:20 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[699460c4-206a-4bea-9d60-deb2ccc18f9c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:21 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD Nov 06 21:27:21 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:21 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 0.746s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6339043-dbf4-47f0-affd-260487df67a5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:21 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-346215095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017d2a13-16c5-4248-80ee-01f39a25ea63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42d3ce5911a4e638e8eb944d6986f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:19Z,use_quota=True,user_id='1e0920f4043f42cf9fcd5a90520ea355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Creating volume 017d2a13-16c5-4248-80ee-01f39a25ea63 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:21 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:27:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:21 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 1073741824 Nov 06 21:27:21 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:21 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 Nov 06 21:27:21 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:22 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56" returned: 0 in 0.794s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:22 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:27:22 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:22 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 1073741824" returned: 0 in 1.028s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:22 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 Nov 06 21:27:22 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:23 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 0.665s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:23 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672 Nov 06 21:27:23 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Flow 'volume_create_manager' (8a98c2c7-96da-45b0-97de-9e457ce1257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69890dc0-89c0-4868-abe6-4e20e46d9bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69890dc0-89c0-4868-abe6-4e20e46d9bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1257678872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4048b4-4199-486d-9975-87d8ae2b3a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0f98a9852744ab808fc4ce81f51d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:23Z,use_quota=True,user_id='02ca8f67de9f46f3a352f1c2ec9f226d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735724c5-704a-44ca-8259-9fa3e0f91a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735724c5-704a-44ca-8259-9fa3e0f91a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e112c0b-8eac-4b93-8574-32f3cdcbbe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:27:23 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63" returned: 0 in 0.528s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Attempting download of 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 017d2a13-16c5-4248-80ee-01f39a25ea63. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5201d-f61c-47f7-a36f-f8a7febeaa93]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_ {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:23 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56.7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" returned: 0 in 0.510s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:23 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_ Nov 06 21:27:23 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-7ee6a92e-94d4-42dc-bbf2-ee3e1a702672" released by "_delete_snapshot" :: held 2.994s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" released by "delete_snapshot" :: held 3.055s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Created reservations ['8cb49d37-35b2-4317-8f64-6eb3abc0a973', '26cd3316-e482-485e-a797-7906c8fcb24d', 'fbca305c-def6-4b55-9db4-cb35667d0452', '37e2df91-ac16-4df6-bd3d-9d3d0d74c3ff'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e112c0b-8eac-4b93-8574-32f3cdcbbe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e4048b4-4199-486d-9975-87d8ae2b3a64', 'volume_name': 'volume-1e4048b4-4199-486d-9975-87d8ae2b3a64', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8687c5-a4bb-49c5-a571-b054e55e7e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8687c5-a4bb-49c5-a571-b054e55e7e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fd77c3-f472-4d43-9589-b041cfc930f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:23 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Volume 1e4048b4-4199-486d-9975-87d8ae2b3a64: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e4048b4-4199-486d-9975-87d8ae2b3a64', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:27:23 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Trying to clone 1e4048b4-4199-486d-9975-87d8ae2b3a64 from image 0758c1e7-1e10-4850-a7cc-546025b05acd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:27:24 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_" returned: 0 in 0.508s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_ {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:24 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Delete snapshot completed successfully. Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9a51fc11-a527-4fe7-8f5e-d6b0e4bae0e3 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-7ee6a92e-94d4-42dc-bbf2-ee3e1a702672-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:24 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_ Nov 06 21:27:24 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:24 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_" returned: 1 in 0.461s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_wle39o9_' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[833cb790-0544-4dac-8d07-48a44daf2450]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:27:24 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19f5bf-5ac9-47c7-ab32-e8af160cc9c0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:24 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD Nov 06 21:27:24 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:24 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD Nov 06 21:27:24 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-eddbc45c-960d-4e4f-a2f9-e63b61365f56-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-eddbc45c-960d-4e4f-a2f9-e63b61365f56-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:25 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD" returned: 0 in 0.604s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] 0758c1e7-1e10-4850-a7cc-546025b05acd was qcow2, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:25 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 Nov 06 21:27:25 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:25 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD" returned: 0 in 0.641s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd is fetched for user 02ca8f67de9f46f3a352f1c2ec9f226d. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1057d8a-5df3-47ba-9384-8f824dc5a92a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[83415242-ec9b-4635-80df-8b9059256ccb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:25 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 Nov 06 21:27:25 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:25 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD Nov 06 21:27:25 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:25 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56" returned: 0 in 0.491s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:25 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56 Nov 06 21:27:25 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:25 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1257678872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4048b4-4199-486d-9975-87d8ae2b3a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0f98a9852744ab808fc4ce81f51d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:23Z,use_quota=True,user_id='02ca8f67de9f46f3a352f1c2ec9f226d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Creating volume 1e4048b4-4199-486d-9975-87d8ae2b3a64 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:25 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:27:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:25 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 1073741824 Nov 06 21:27:25 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:26 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eddbc45c-960d-4e4f-a2f9-e63b61365f56" returned: 0 in 0.526s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-quobyte-eddbc45c-960d-4e4f-a2f9-e63b61365f56" released by "delete_volume" :: held 1.184s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Created reservations ['50907383-dc6f-4cf2-8bec-27d8cad87167', '5bbca442-285f-44ef-ac30-76991b797511', 'b1572d01-9cc0-465f-a651-645a924f725a', '2b58a25f-cf8f-42e3-a4a5-daa03db54fb5'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:26 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:27:26 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:26 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 1073741824" returned: 0 in 0.995s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:27 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 Nov 06 21:27:27 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:27 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.629s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Deleted volume successfully. Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ad65762-fd13-43f2-b94d-1f639c8b25e6 tempest-VolumesSnapshotListTestJSON-1610704609 None] Lock "cinder-eddbc45c-960d-4e4f-a2f9-e63b61365f56-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:27 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64" returned: 0 in 0.696s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:27 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Attempting download of 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 1e4048b4-4199-486d-9975-87d8ae2b3a64. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f93e63-e9ea-4169-bf56-8d701cd024a8]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:28 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200 Nov 06 21:27:28 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:28 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63" returned: 0 in 3.356s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_lm2zsj35devstack@QuobyteHD, size 112.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:28 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Converted 112.00 MB image at 33.31 MB/s Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:28 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 1G Nov 06 21:27:28 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:28 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200" returned: 0 in 0.822s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:28 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 1G" returned: 0 in 0.516s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Downloaded image 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 017d2a13-16c5-4248-80ee-01f39a25ea63 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd for user 1e0920f4043f42cf9fcd5a90520ea355 is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Marking volume 017d2a13-16c5-4248-80ee-01f39a25ea63 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:27:29 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200 Nov 06 21:27:29 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Copying metadata from image 0758c1e7-1e10-4850-a7cc-546025b05acd to 017d2a13-16c5-4248-80ee-01f39a25ea63. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Creating volume glance metadata for volume 017d2a13-16c5-4248-80ee-01f39a25ea63 backed by image 0758c1e7-1e10-4850-a7cc-546025b05acd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1eebba4-30a6-46ac-9502-00999fd4ab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017d2a13-16c5-4248-80ee-01f39a25ea63', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be66923-6524-4e38-9e2a-d42b5e129aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Volume volume-017d2a13-16c5-4248-80ee-01f39a25ea63 (017d2a13-16c5-4248-80ee-01f39a25ea63): created successfully Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be66923-6524-4e38-9e2a-d42b5e129aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Flow 'volume_create_manager' (7237ba53-2d52-42ea-8a63-f0fe8bda42b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:29 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a738599e-546c-46c0-8629-0a553d8f8604 tempest-VolumesImageMetadata-2074462107 None] Created volume successfully. Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200" returned: 1 in 0.579s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0758c1e7-1e10-4850-a7cc-546025b05acd_7y4mf200' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e7ec9-e9e3-40aa-9ad3-3bb1232c092f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:29 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD Nov 06 21:27:29 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:29 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] 0758c1e7-1e10-4850-a7cc-546025b05acd was qcow2, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:27:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:29 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 Nov 06 21:27:29 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Acquiring lock "cinder-017d2a13-16c5-4248-80ee-01f39a25ea63-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Lock "cinder-017d2a13-16c5-4248-80ee-01f39a25ea63-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Acquiring lock "cinder-quobyte-017d2a13-16c5-4248-80ee-01f39a25ea63" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Lock "cinder-quobyte-017d2a13-16c5-4248-80ee-01f39a25ea63" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1784182a-af14-4f44-b612-cf2bb5a33cf3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:31 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 Nov 06 21:27:31 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63" returned: 0 in 0.536s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:32 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63 Nov 06 21:27:32 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:27:32 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-017d2a13-16c5-4248-80ee-01f39a25ea63" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Lock "cinder-quobyte-017d2a13-16c5-4248-80ee-01f39a25ea63" released by "delete_volume" :: held 0.984s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:32 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64" returned: 0 in 2.630s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0758c1e7-1e10-4850-a7cc-546025b05acd_d_kz4fljdevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:27:32 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Converted 112.00 MB image at 42.55 MB/s Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Created reservations ['a140174b-9a20-4fd5-a451-b793cc4022ab', '1213a936-e729-451e-927b-bfd0566e53e3', '6ef45f3d-3abb-4fd3-9428-f3dcd92c42ab', 'f21b0ccc-edad-46e0-b37e-ae7b5acd7203'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:32 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 1G Nov 06 21:27:32 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:32 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:27:32 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:32 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 1G" returned: 0 in 0.460s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:32 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Downloaded image 0758c1e7-1e10-4850-a7cc-546025b05acd ((None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}])) to volume 1e4048b4-4199-486d-9975-87d8ae2b3a64 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Temporary image 0758c1e7-1e10-4850-a7cc-546025b05acd for user 02ca8f67de9f46f3a352f1c2ec9f226d is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Marking volume 1e4048b4-4199-486d-9975-87d8ae2b3a64 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Copying metadata from image 0758c1e7-1e10-4850-a7cc-546025b05acd to 1e4048b4-4199-486d-9975-87d8ae2b3a64. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Creating volume glance metadata for volume 1e4048b4-4199-486d-9975-87d8ae2b3a64 backed by image 0758c1e7-1e10-4850-a7cc-546025b05acd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:27:33 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.346s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Deleted volume successfully. Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-01400761-18c5-44b8-8f8d-a9709cb5516b tempest-VolumesImageMetadata-2074462107 None] Lock "cinder-017d2a13-16c5-4248-80ee-01f39a25ea63-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fd77c3-f472-4d43-9589-b041cfc930f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4048b4-4199-486d-9975-87d8ae2b3a64', 'volume_size': 1, 'image_id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0758c1e7-1e10-4850-a7cc-546025b05acd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '145054c4f69a4ba28142205367834b8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0758c1e7-1e10-4850-a7cc-546025b05acd', 'created_at': datetime.datetime(2026, 11, 6, 20, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0758c1e7-1e10-4850-a7cc-546025b05acd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5d7369-759e-49c2-a655-f52daf8295ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:33 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Volume volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 (1e4048b4-4199-486d-9975-87d8ae2b3a64): created successfully Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5d7369-759e-49c2-a655-f52daf8295ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Flow 'volume_create_manager' (8a98c2c7-96da-45b0-97de-9e457ce1257b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-729caa54-5e5f-468d-a7cb-0a8f41611835 tempest-TestShelveInstance-201131307 None] Created volume successfully. Nov 06 21:27:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-31755413-8ba1-44d3-948c-fb38e8d7da3c req-7854b755-7180-473b-8ce0-74d0697adb70 tempest-TestShelveInstance-201131307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-31755413-8ba1-44d3-948c-fb38e8d7da3c req-7854b755-7180-473b-8ce0-74d0697adb70 tempest-TestShelveInstance-201131307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-31755413-8ba1-44d3-948c-fb38e8d7da3c req-7854b755-7180-473b-8ce0-74d0697adb70 tempest-TestShelveInstance-201131307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-31755413-8ba1-44d3-948c-fb38e8d7da3c req-7854b755-7180-473b-8ce0-74d0697adb70 tempest-TestShelveInstance-201131307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-1e4048b4-4199-486d-9975-87d8ae2b3a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '696df6df-1c2b-42f5-870f-05766ebb78db', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:27:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-31755413-8ba1-44d3-948c-fb38e8d7da3c req-7854b755-7180-473b-8ce0-74d0697adb70 tempest-TestShelveInstance-201131307 None] attachment_update completed successfully. Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Flow 'volume_create_manager' (61877466-1b12-40e4-96ad-f511a1be6b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818c1595-eeb4-42be-92d5-c99960467c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818c1595-eeb4-42be-92d5-c99960467c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2006489516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0d39eb-9408-410b-880c-369a8f43ce31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83410139105c4de6b6fc932f39b7da6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:41Z,use_quota=True,user_id='a44235b0e1404dcbbf7102ade56055b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4566f09-69e6-4c41-8a4c-794334fb9dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4566f09-69e6-4c41-8a4c-794334fb9dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29ea205-0656-42b3-a678-3053383d19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29ea205-0656-42b3-a678-3053383d19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0d39eb-9408-410b-880c-369a8f43ce31', 'volume_name': 'volume-df0d39eb-9408-410b-880c-369a8f43ce31', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1cf677-8d80-404b-aae0-00d70e362c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1cf677-8d80-404b-aae0-00d70e362c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12885bc-ba58-4c5d-a67d-50d7229ca3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Volume df0d39eb-9408-410b-880c-369a8f43ce31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0d39eb-9408-410b-880c-369a8f43ce31', 'volume_size': 1} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2006489516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0d39eb-9408-410b-880c-369a8f43ce31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83410139105c4de6b6fc932f39b7da6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:41Z,use_quota=True,user_id='a44235b0e1404dcbbf7102ade56055b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Creating volume df0d39eb-9408-410b-880c-369a8f43ce31 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:41 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:41 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 1073741824 Nov 06 21:27:41 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 1073741824" returned: 0 in 0.581s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:41 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 Nov 06 21:27:41 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:41 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31" returned: 0 in 0.360s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12885bc-ba58-4c5d-a67d-50d7229ca3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0d39eb-9408-410b-880c-369a8f43ce31', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8830a0-e37d-4045-a291-f4421207e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Volume volume-df0d39eb-9408-410b-880c-369a8f43ce31 (df0d39eb-9408-410b-880c-369a8f43ce31): created successfully Nov 06 21:27:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8830a0-e37d-4045-a291-f4421207e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Flow 'volume_create_manager' (61877466-1b12-40e4-96ad-f511a1be6b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-36feb70f-8af1-4506-8c80-683a296ac626 tempest-VolumesTransfersV355Test-339411861 None] Created volume successfully. Nov 06 21:27:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ca2ae7ca-7fb8-4d15-a112-e3149f6d5836 tempest-VolumesTransfersV355Test-479899604 None] Transfer volume completed successfully. Nov 06 21:27:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Acquiring lock "cinder-df0d39eb-9408-410b-880c-369a8f43ce31-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-df0d39eb-9408-410b-880c-369a8f43ce31-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Acquiring lock "cinder-quobyte-df0d39eb-9408-410b-880c-369a8f43ce31" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-quobyte-df0d39eb-9408-410b-880c-369a8f43ce31" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a09f58-0c23-458b-b2d4-19afb4ed0d71]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 Nov 06 21:27:46 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:46 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31" returned: 0 in 0.593s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:46 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31 Nov 06 21:27:46 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:46 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df0d39eb-9408-410b-880c-369a8f43ce31" returned: 0 in 0.390s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-quobyte-df0d39eb-9408-410b-880c-369a8f43ce31" released by "delete_volume" :: held 1.091s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Created reservations ['bc1a3274-aa65-4949-9cdc-3b43872c09d4', 'b72bf7c4-c655-4684-8643-9596e7d1c354', 'b38ee8a3-dc6b-459e-8fba-c73b7308a94e', 'c28f6173-2e0d-49f8-9d8b-a3b815634042'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:47 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:27:47 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:47 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.518s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Deleted volume successfully. Nov 06 21:27:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5ef24d36-eac1-4a11-8c04-8c21c2011b01 tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-df0d39eb-9408-410b-880c-369a8f43ce31-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:48 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Flow 'volume_create_manager' (4c9b6675-6047-4bd2-9f89-2dd3aa42059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a4d787-dc15-4729-8c4f-d1a58c3efff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a4d787-dc15-4729-8c4f-d1a58c3efff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-504924030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1c915a-fdcf-4206-8168-6758ef96827b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83410139105c4de6b6fc932f39b7da6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:49Z,use_quota=True,user_id='a44235b0e1404dcbbf7102ade56055b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7853d0aa-7f18-489d-8762-b889d0e1ea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7853d0aa-7f18-489d-8762-b889d0e1ea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377ce9eb-9a62-44c7-ac07-162a4b936889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377ce9eb-9a62-44c7-ac07-162a4b936889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1c915a-fdcf-4206-8168-6758ef96827b', 'volume_name': 'volume-ef1c915a-fdcf-4206-8168-6758ef96827b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7827be9-a54c-4147-a30a-4d4f357f70eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7827be9-a54c-4147-a30a-4d4f357f70eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40d2447-0fc2-47ad-afd7-b6a1711a500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Volume ef1c915a-fdcf-4206-8168-6758ef96827b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1c915a-fdcf-4206-8168-6758ef96827b', 'volume_size': 1} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-504924030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1c915a-fdcf-4206-8168-6758ef96827b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83410139105c4de6b6fc932f39b7da6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:27:49Z,use_quota=True,user_id='a44235b0e1404dcbbf7102ade56055b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Creating volume ef1c915a-fdcf-4206-8168-6758ef96827b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:27:49 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:27:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:49 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b 1073741824 Nov 06 21:27:49 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:50 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b 1073741824" returned: 0 in 0.889s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:50 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b Nov 06 21:27:50 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:50 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b" returned: 0 in 0.463s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40d2447-0fc2-47ad-afd7-b6a1711a500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1c915a-fdcf-4206-8168-6758ef96827b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9d7433-507d-4325-b789-d466ed58de07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:27:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Volume volume-ef1c915a-fdcf-4206-8168-6758ef96827b (ef1c915a-fdcf-4206-8168-6758ef96827b): created successfully Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9d7433-507d-4325-b789-d466ed58de07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:27:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Flow 'volume_create_manager' (4c9b6675-6047-4bd2-9f89-2dd3aa42059d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:27:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3c7ce210-c4c0-4fb6-ad85-134f58a107cc tempest-VolumesTransfersV355Test-339411861 None] Created volume successfully. Nov 06 21:27:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Acquiring lock "cinder-ef1c915a-fdcf-4206-8168-6758ef96827b-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-ef1c915a-fdcf-4206-8168-6758ef96827b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Acquiring lock "cinder-quobyte-ef1c915a-fdcf-4206-8168-6758ef96827b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:27:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-quobyte-ef1c915a-fdcf-4206-8168-6758ef96827b" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:27:52 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[40add6e4-a12b-4b46-a410-91115c9f6b64]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:27:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:52 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b Nov 06 21:27:52 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:53 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b" returned: 0 in 0.826s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:53 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b Nov 06 21:27:53 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:53 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ef1c915a-fdcf-4206-8168-6758ef96827b" returned: 0 in 0.395s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-quobyte-ef1c915a-fdcf-4206-8168-6758ef96827b" released by "delete_volume" :: held 1.338s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Created reservations ['0fa971db-e2ae-450e-97ff-6680314399f9', '866ca936-b8f5-498b-9877-2031ee0bab1a', '5b3da01e-d5a9-4c83-80c5-2fc17073a19c', '845bc651-dbc0-456c-9198-8a503457cdb5'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:27:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:27:53 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:27:53 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:27:54 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Nov 06 21:27:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.575s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:27:54 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:27:54 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Deleted volume successfully. Nov 06 21:27:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5d6bc015-e037-44c9-9422-32404a74bc1f tempest-VolumesTransfersV355Test-63249258 None] Lock "cinder-ef1c915a-fdcf-4206-8168-6758ef96827b-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:03 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=64,cinder:INSERT=29,cinder:UPDATE=64,cinder:DELETE=2 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:04 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=66,cinder:INSERT=30,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:28:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-417660a0-dbf7-4c1e-becf-0895e07edee6 req-407a0f17-2299-44b3-a757-8939f31e5d2d tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-417660a0-dbf7-4c1e-becf-0895e07edee6 req-407a0f17-2299-44b3-a757-8939f31e5d2d tempest-TestStampPattern-1838259923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-417660a0-dbf7-4c1e-becf-0895e07edee6 req-407a0f17-2299-44b3-a757-8939f31e5d2d tempest-TestStampPattern-1838259923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-417660a0-dbf7-4c1e-becf-0895e07edee6 req-407a0f17-2299-44b3-a757-8939f31e5d2d tempest-TestStampPattern-1838259923 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-cee5f9e6-7b79-47e2-bd28-42879807ff28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8de5aec8-8756-4755-abd5-d351b5b60a40', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:28:06 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-417660a0-dbf7-4c1e-becf-0895e07edee6 req-407a0f17-2299-44b3-a757-8939f31e5d2d tempest-TestStampPattern-1838259923 None] attachment_update completed successfully. Nov 06 21:28:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-38f13446-4c20-4679-967f-0286ae56e5f8 req-f43ae92e-5090-4415-b064-f4be08a6191f tempest-TestStampPattern-1838259923 None] Terminate volume connection completed successfully. Nov 06 21:28:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-38f13446-4c20-4679-967f-0286ae56e5f8 req-f43ae92e-5090-4415-b064-f4be08a6191f tempest-TestStampPattern-1838259923 None] Deleting attachment 8de5aec8-8756-4755-abd5-d351b5b60a40. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Flow 'volume_create_manager' (0ffe70d5-720c-4232-b083-4285057516b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b209bde6-76f9-4734-bfee-26d036cc4d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b209bde6-76f9-4734-bfee-26d036cc4d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-315039314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc7125d-2055-41a3-a72d-4f90137938fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c85693f25ef4667be9fd4215da5dd68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:16Z,use_quota=True,user_id='df078e34b067472a88d7d08e1e6a8953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757b79c8-43d0-4c72-b291-d36db966a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757b79c8-43d0-4c72-b291-d36db966a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068f1f54-fc69-4d83-9782-bfc67c416406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068f1f54-fc69-4d83-9782-bfc67c416406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc7125d-2055-41a3-a72d-4f90137938fc', 'volume_name': 'volume-3cc7125d-2055-41a3-a72d-4f90137938fc', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47cd1df-4d4a-482b-9ec2-5b3b274db181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47cd1df-4d4a-482b-9ec2-5b3b274db181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bccddc2-77ab-47b6-afa8-f4854727deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:15 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Volume 3cc7125d-2055-41a3-a72d-4f90137938fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc7125d-2055-41a3-a72d-4f90137938fc', 'volume_size': 1} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-315039314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc7125d-2055-41a3-a72d-4f90137938fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c85693f25ef4667be9fd4215da5dd68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:16Z,use_quota=True,user_id='df078e34b067472a88d7d08e1e6a8953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Creating volume 3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:15 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:28:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:15 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc 1073741824 Nov 06 21:28:15 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:16 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc 1073741824" returned: 0 in 0.996s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:16 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:28:16 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:17 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.444s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bccddc2-77ab-47b6-afa8-f4854727deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc7125d-2055-41a3-a72d-4f90137938fc', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c01fc6-8aeb-4ce1-b656-823af8e84cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:17 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Volume volume-3cc7125d-2055-41a3-a72d-4f90137938fc (3cc7125d-2055-41a3-a72d-4f90137938fc): created successfully Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c01fc6-8aeb-4ce1-b656-823af8e84cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Flow 'volume_create_manager' (0ffe70d5-720c-4232-b083-4285057516b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:17 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-08d955dc-f312-403d-8080-d38586e5bb3d tempest-VolumesActionsTest-737574812 None] Created volume successfully. Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-cee5f9e6-7b79-47e2-bd28-42879807ff28-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Lock "cinder-cee5f9e6-7b79-47e2-bd28-42879807ff28-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-quobyte-cee5f9e6-7b79-47e2-bd28-42879807ff28" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-cee5f9e6-7b79-47e2-bd28-42879807ff28" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7630b2-d618-4ae8-a8e6-586c97172c37]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:17 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 Nov 06 21:28:17 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:18 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28" returned: 0 in 0.603s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:18 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28 Nov 06 21:28:18 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:18 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-cee5f9e6-7b79-47e2-bd28-42879807ff28" returned: 0 in 0.582s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-cee5f9e6-7b79-47e2-bd28-42879807ff28" released by "delete_volume" :: held 1.296s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Created reservations ['7da433c3-5111-4fc6-9efd-b6b2efdb204c', 'dfb44deb-5f96-45a4-8bce-34cfda5561f8', '16d9a9f8-bd5f-4eac-83e7-f8b0535b5954', 'e8871b54-3d18-4a81-9419-79612aadd980'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:19 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:28:19 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:19 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.415s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Deleted volume successfully. Nov 06 21:28:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8823a66-e078-4809-91f8-63695a45fbf1 tempest-TestStampPattern-1838259923 None] Lock "cinder-cee5f9e6-7b79-47e2-bd28-42879807ff28-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-8bcac80e-127d-41a0-a38c-0511e45e16c0-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Lock "cinder-8bcac80e-127d-41a0-a38c-0511e45e16c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-quobyte-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-quobyte-8bcac80e-127d-41a0-a38c-0511e45e16c0" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-8bcac80e-127d-41a0-a38c-0511e45e16c0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Deleting offline snapshot 8bcac80e-127d-41a0-a38c-0511e45e16c0 of volume 4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] snapshot_file for this snap is: volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a76bc-0837-4a10-a9bf-919bd7885d78]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:20 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 Nov 06 21:28:20 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:21 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0" returned: 0 in 0.545s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:21 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:28:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f2e0ea-470d-4c03-8989-4d521a7fa39d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:21 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f Nov 06 21:28:21 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:22 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" returned: 0 in 0.869s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:22 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 Nov 06 21:28:22 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:22 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0" returned: 0 in 0.508s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:22 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0 Nov 06 21:28:22 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:23 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f.8bcac80e-127d-41a0-a38c-0511e45e16c0" returned: 0 in 0.725s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-8bcac80e-127d-41a0-a38c-0511e45e16c0" released by "_delete_snapshot" :: held 2.882s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" released by "delete_snapshot" :: held 2.921s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:23 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Created reservations ['46926972-c38a-4490-881f-c3c98180fd9f', 'c29714fa-2858-4540-9348-ba9992f2f84d', '82e2ce83-aa36-4d08-8b40-d6d76cca31e5', 'f7bb3175-0766-45bb-8bd7-9814a62305a4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:28:23 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Delete snapshot completed successfully. Nov 06 21:28:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e3662e4-ccae-4988-b0a8-953dafae5dd0 tempest-TestStampPattern-1838259923 None] Lock "cinder-8bcac80e-127d-41a0-a38c-0511e45e16c0-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-191d210d-f9c9-4477-af81-3e451bd9314b tempest-VolumesActionsTest-737574812 None] Acquiring lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc" by "attach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-191d210d-f9c9-4477-af81-3e451bd9314b tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc" acquired by "attach_volume" :: waited 0.148s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:32 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:28:32 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:32 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-191d210d-f9c9-4477-af81-3e451bd9314b tempest-VolumesActionsTest-737574812 None] Attaching volume 3cc7125d-2055-41a3-a72d-4f90137938fc to instance 1be88ca8-812c-4baa-bcb7-6072ac51e5a6 at mountpoint /dev/vdb on host None. Nov 06 21:28:32 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-191d210d-f9c9-4477-af81-3e451bd9314b tempest-VolumesActionsTest-737574812 None] Attach volume completed successfully. Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-191d210d-f9c9-4477-af81-3e451bd9314b tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc" released by "attach_volume" :: held 0.401s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:32 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.657s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:28:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:28:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-274328a1-af4d-4433-a805-61a10ae4d85b tempest-VolumesActionsTest-737574812 None] Acquiring lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-detach_volume" by "detach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-274328a1-af4d-4433-a805-61a10ae4d85b tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-274328a1-af4d-4433-a805-61a10ae4d85b tempest-VolumesActionsTest-737574812 None] Detaching volume 3cc7125d-2055-41a3-a72d-4f90137938fc from instance 1be88ca8-812c-4baa-bcb7-6072ac51e5a6. Nov 06 21:28:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-274328a1-af4d-4433-a805-61a10ae4d85b tempest-VolumesActionsTest-737574812 None] Detach volume completed successfully. Nov 06 21:28:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-274328a1-af4d-4433-a805-61a10ae4d85b tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Lock "cinder-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Acquiring lock "cinder-quobyte-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" acquired by "delete_volume" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c03b6-57ff-4453-a032-adf6dc258f58]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:34 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f Nov 06 21:28:34 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" returned: 0 in 0.602s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:35 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f Nov 06 21:28:35 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:35 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" returned: 0 in 0.467s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Lock "cinder-quobyte-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f" released by "delete_volume" :: held 1.196s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Created reservations ['fcf54cbc-2db9-4459-b969-7da948c10507', 'cec51420-3c53-4647-acf1-aa4b379bb08b', '79cff6f2-2817-4055-99ed-fcd0063040f0', 'e4db08e5-ffb0-43b7-9a43-93f4e546ade5'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:28:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:36 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:28:36 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:37 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.894s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:37 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:28:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Deleted volume successfully. Nov 06 21:28:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-31e36f66-6fed-4840-b3cd-28b57cad44ef req-dc8f8660-1035-454b-8dda-5c5ba9b10d7a tempest-TestShelveInstance-201131307 None] Terminate volume connection completed successfully. Nov 06 21:28:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-31e36f66-6fed-4840-b3cd-28b57cad44ef req-dc8f8660-1035-454b-8dda-5c5ba9b10d7a tempest-TestShelveInstance-201131307 None] Deleting attachment 696df6df-1c2b-42f5-870f-05766ebb78db. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:28:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58baa3f6-9158-4088-91ad-075d2f638175 tempest-TestStampPattern-1838259923 None] Lock "cinder-4de4e1f4-0ce8-4c77-bbf8-8555f1351d9f-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-558a952f-4652-4a03-a52a-7189aaf9ec1d req-e375d4ba-7685-4e80-93b0-36fd6a440ef3 tempest-TestShelveInstance-201131307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-558a952f-4652-4a03-a52a-7189aaf9ec1d req-e375d4ba-7685-4e80-93b0-36fd6a440ef3 tempest-TestShelveInstance-201131307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-558a952f-4652-4a03-a52a-7189aaf9ec1d req-e375d4ba-7685-4e80-93b0-36fd6a440ef3 tempest-TestShelveInstance-201131307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-558a952f-4652-4a03-a52a-7189aaf9ec1d req-e375d4ba-7685-4e80-93b0-36fd6a440ef3 tempest-TestShelveInstance-201131307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-1e4048b4-4199-486d-9975-87d8ae2b3a64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1c33e6a-f3ed-47d6-b0e1-ae550781b9b3', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:28:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-558a952f-4652-4a03-a52a-7189aaf9ec1d req-e375d4ba-7685-4e80-93b0-36fd6a440ef3 tempest-TestShelveInstance-201131307 None] attachment_update completed successfully. Nov 06 21:28:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5dbf10f9-d084-494d-a382-7149836cbf5d tempest-VolumesActionsTest-737574812 None] Acquiring lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc" by "attach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5dbf10f9-d084-494d-a382-7149836cbf5d tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc" acquired by "attach_volume" :: waited 0.037s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5dbf10f9-d084-494d-a382-7149836cbf5d tempest-VolumesActionsTest-737574812 None] Attaching volume 3cc7125d-2055-41a3-a72d-4f90137938fc to instance dbe5221b-ddf1-42a3-a08d-310f8a1fa8f4 at mountpoint /dev/vdb on host None. Nov 06 21:28:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5dbf10f9-d084-494d-a382-7149836cbf5d tempest-VolumesActionsTest-737574812 None] Attach volume completed successfully. Nov 06 21:28:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5dbf10f9-d084-494d-a382-7149836cbf5d tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc" released by "attach_volume" :: held 0.152s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e894352-49e5-495a-9046-0f2871c8653b tempest-VolumesActionsTest-737574812 None] Acquiring lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-detach_volume" by "detach_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:28:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e894352-49e5-495a-9046-0f2871c8653b tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:28:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e894352-49e5-495a-9046-0f2871c8653b tempest-VolumesActionsTest-737574812 None] Detaching volume 3cc7125d-2055-41a3-a72d-4f90137938fc from instance dbe5221b-ddf1-42a3-a08d-310f8a1fa8f4. Nov 06 21:28:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e894352-49e5-495a-9046-0f2871c8653b tempest-VolumesActionsTest-737574812 None] Detach volume completed successfully. Nov 06 21:28:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e894352-49e5-495a-9046-0f2871c8653b tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Flow 'volume_create_manager' (59e86a00-808b-40f3-84ef-005a8edf6a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7986d228-3ac6-4aca-ae9b-e62646c037a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7986d228-3ac6-4aca-ae9b-e62646c037a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-629981195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b8f383-d3b8-4433-9f68-55a4d3ec023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a233c4b1a50042328031dcab01a1625a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:54Z,use_quota=True,user_id='52af18cc2c6c46e29f88d0c6a4781742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faaeab08-be54-4fa4-b103-7d4c0b7fb8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faaeab08-be54-4fa4-b103-7d4c0b7fb8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ca03b3-6ba2-4979-86bc-d14b7aa77766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ca03b3-6ba2-4979-86bc-d14b7aa77766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b8f383-d3b8-4433-9f68-55a4d3ec023e', 'volume_name': 'volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff4481b-137a-4d61-b7c9-3eeb1b7bdcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff4481b-137a-4d61-b7c9-3eeb1b7bdcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f047ba6c-f59a-441f-b860-eabfe314bec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:54 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Volume 10b8f383-d3b8-4433-9f68-55a4d3ec023e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e', 'volume_size': 1} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-629981195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b8f383-d3b8-4433-9f68-55a4d3ec023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a233c4b1a50042328031dcab01a1625a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:28:54Z,use_quota=True,user_id='52af18cc2c6c46e29f88d0c6a4781742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Creating volume 10b8f383-d3b8-4433-9f68-55a4d3ec023e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:28:54 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:54 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e 1073741824 Nov 06 21:28:54 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:54 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e 1073741824" returned: 0 in 0.765s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:54 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e Nov 06 21:28:54 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:55 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e" returned: 0 in 0.368s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f047ba6c-f59a-441f-b860-eabfe314bec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea6c9fa-bfdb-4b2d-b9d6-f289836b7543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:55 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Volume volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e (10b8f383-d3b8-4433-9f68-55a4d3ec023e): created successfully Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea6c9fa-bfdb-4b2d-b9d6-f289836b7543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Flow 'volume_create_manager' (59e86a00-808b-40f3-84ef-005a8edf6a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ca752f4f-909a-4f01-9d6c-10065ef33ca1 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Created volume successfully. Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b9eb19-cb5c-4fe1-bb54-01f06dc2c836]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:56 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:28:56 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:56 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.441s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f0b1d3-3aff-4afd-923f-5702b1684b5a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-195da557-879f-4d58-a1ca-b3289e695eef req-939557bf-fb02-4468-8cad-a49b719b5e6d tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:28:56 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:28:56 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:57 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Nov 06 21:28:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.387s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:28:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.fcfe4f2d-c616-4145-b86d-8d13d92091ae9j3ooipb.img {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:28:57 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.fcfe4f2d-c616-4145-b86d-8d13d92091ae9j3ooipb.img Nov 06 21:28:57 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:28:59 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:28:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (40315724-cf94-47cb-80d6-98a688fefa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:28:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6478e75c-da6a-4e34-a56c-cf222a70c3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6478e75c-da6a-4e34-a56c-cf222a70c3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2131238188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e028d829-b31a-4c7a-bde3-373b6b675f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:00Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:28:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b941494-bf43-4907-bdd3-e3edd1009cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:28:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b941494-bf43-4907-bdd3-e3edd1009cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7579d51-cfca-4853-a0a5-3543dba975b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7579d51-cfca-4853-a0a5-3543dba975b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e028d829-b31a-4c7a-bde3-373b6b675f46', 'volume_name': 'volume-e028d829-b31a-4c7a-bde3-373b6b675f46', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2443bf5-8336-4ed2-8ee0-80cfa2f8790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2443bf5-8336-4ed2-8ee0-80cfa2f8790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7d6091-62ef-496b-90c6-638dd48346f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Volume e028d829-b31a-4c7a-bde3-373b6b675f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e028d829-b31a-4c7a-bde3-373b6b675f46', 'volume_size': 1} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:00 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (692651d9-ff5e-499c-8f58-758450e3b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d35c47c-5d77-4f7f-88e1-01af1346fb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d35c47c-5d77-4f7f-88e1-01af1346fb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455607442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1142efa-83e8-49a1-8675-095c20bfa2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:01Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0fb471-0006-4035-bd37-8abd406df579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0fb471-0006-4035-bd37-8abd406df579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c4923c-fe0d-4be6-b325-6254e9d74cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c4923c-fe0d-4be6-b325-6254e9d74cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1142efa-83e8-49a1-8675-095c20bfa2ba', 'volume_name': 'volume-c1142efa-83e8-49a1-8675-095c20bfa2ba', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223de9b4-5d87-4abf-978e-ab532efd11de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223de9b4-5d87-4abf-978e-ab532efd11de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad3246f-b448-45a3-acdb-95be247cccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:01 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Volume c1142efa-83e8-49a1-8675-095c20bfa2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1142efa-83e8-49a1-8675-095c20bfa2ba', 'volume_size': 1} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (50e57904-c9f1-4498-9748-935648cc7eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f6f819-9168-4b58-aa9c-cd18b823c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f6f819-9168-4b58-aa9c-cd18b823c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1728354745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192aa4d8-659a-4c8b-b743-ce48a1d2350e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:02Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3738b414-cf87-411d-aa25-a12c82f342be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3738b414-cf87-411d-aa25-a12c82f342be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5348cab-5ef0-43c7-ac59-ca30dad321cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5348cab-5ef0-43c7-ac59-ca30dad321cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192aa4d8-659a-4c8b-b743-ce48a1d2350e', 'volume_name': 'volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8724ea97-a4af-4c5d-a129-906431798225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8724ea97-a4af-4c5d-a129-906431798225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d956b4-2ee8-40ca-abe5-30c944eecd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Volume 192aa4d8-659a-4c8b-b743-ce48a1d2350e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e', 'volume_size': 1} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (f7f0d759-0466-4014-ae03-968d694cb9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653fa894-5381-4bcb-b334-03a78e54e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653fa894-5381-4bcb-b334-03a78e54e91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865451864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaa6321-dbe8-4217-9ac1-d5f5bcb598fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:03Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c2cf9c-6bfd-4bde-8548-2afb542fb8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c2cf9c-6bfd-4bde-8548-2afb542fb8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef01535c-1132-4386-895b-d9971c4187c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef01535c-1132-4386-895b-d9971c4187c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaa6321-dbe8-4217-9ac1-d5f5bcb598fd', 'volume_name': 'volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618ccf8c-8c48-4db4-96a4-7b7f3ac2c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618ccf8c-8c48-4db4-96a4-7b7f3ac2c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f975ca-cc49-43fa-9cc1-a51846cb1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Volume acaa6321-dbe8-4217-9ac1-d5f5bcb598fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd', 'volume_size': 1} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (1132bd56-15b1-43d7-8a71-e9ac4a72a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b00a3-bc44-415f-9c05-80d33a6bf3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b00a3-bc44-415f-9c05-80d33a6bf3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241249826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d4c598-10f7-4783-8fe9-0e9a7d5e4968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:03Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9913af1a-e30e-4cf9-864a-836569ed24a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9913af1a-e30e-4cf9-864a-836569ed24a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e5f2d-cb03-40de-a731-4669952d0751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3e5f2d-cb03-40de-a731-4669952d0751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d4c598-10f7-4783-8fe9-0e9a7d5e4968', 'volume_name': 'volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff98339-7cee-447c-ac9d-c5edcde03482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff98339-7cee-447c-ac9d-c5edcde03482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9563e9-b3ee-4aab-8f8d-ccd7441b0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Volume 84d4c598-10f7-4783-8fe9-0e9a7d5e4968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968', 'volume_size': 1} Nov 06 21:29:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:06 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.fcfe4f2d-c616-4145-b86d-8d13d92091ae9j3ooipb.img" returned: 0 in 8.777s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd3ddf-0625-4833-9b37-4a8586f74432]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:06 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:29:06 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:06 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.533s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.fcfe4f2d-c616-4145-b86d-8d13d92091ae9j3ooipb.img {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:29:06 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Converted 1024.00 MB image at 116.65 MB/s Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=54,cinder:UPDATE=40,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=57,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:29:06 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] fcfe4f2d-c616-4145-b86d-8d13d92091ae was raw, no need to convert to raw {{(pid=87350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.020s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Uploaded volume to glance image-id: fcfe4f2d-c616-4145-b86d-8d13d92091ae. {{(pid=87350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1821}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-195da557-879f-4d58-a1ca-b3289e695eef req-939557bf-fb02-4468-8cad-a49b719b5e6d tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.462s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-195da557-879f-4d58-a1ca-b3289e695eef req-939557bf-fb02-4468-8cad-a49b719b5e6d tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.318s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2131238188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e028d829-b31a-4c7a-bde3-373b6b675f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:00Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Creating volume e028d829-b31a-4c7a-bde3-373b6b675f46 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:25 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-89f1cbd2-c82f-47ef-8ed9-36af38e55910 tempest-VolumesActionsTest-737574812 None] Copy volume to image completed successfully. Nov 06 21:29:25 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 1073741824 Nov 06 21:29:25 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-195da557-879f-4d58-a1ca-b3289e695eef req-939557bf-fb02-4468-8cad-a49b719b5e6d tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef8225bc-c93f-4f92-838c-dbad50330aa3', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:29:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-195da557-879f-4d58-a1ca-b3289e695eef req-939557bf-fb02-4468-8cad-a49b719b5e6d tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] attachment_update completed successfully. Nov 06 21:29:25 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 1073741824" returned: 0 in 0.589s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:26 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 Nov 06 21:29:26 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:26 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46" returned: 0 in 0.300s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.997s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455607442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1142efa-83e8-49a1-8675-095c20bfa2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:01Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Creating volume c1142efa-83e8-49a1-8675-095c20bfa2ba {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7d6091-62ef-496b-90c6-638dd48346f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e028d829-b31a-4c7a-bde3-373b6b675f46', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594532d1-a2ed-4a34-96e0-d6865cf5a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:26 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba 1073741824 Nov 06 21:29:26 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Volume volume-e028d829-b31a-4c7a-bde3-373b6b675f46 (e028d829-b31a-4c7a-bde3-373b6b675f46): created successfully Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594532d1-a2ed-4a34-96e0-d6865cf5a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (40315724-cf94-47cb-80d6-98a688fefa80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:26 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8f7a0599-5d4b-4fad-ae42-f54657a75f3b tempest-CreateVolumesFromImageTest-1614369105 None] Created volume successfully. Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:26 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba 1073741824" returned: 0 in 0.546s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:26 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba Nov 06 21:29:26 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:27 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.108s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1728354745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192aa4d8-659a-4c8b-b743-ce48a1d2350e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:02Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Creating volume 192aa4d8-659a-4c8b-b743-ce48a1d2350e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:27 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad3246f-b448-45a3-acdb-95be247cccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1142efa-83e8-49a1-8675-095c20bfa2ba', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebabbb86-d9ec-4e96-91bb-2ffe33b47485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:27 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e 1073741824 Nov 06 21:29:27 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Volume volume-c1142efa-83e8-49a1-8675-095c20bfa2ba (c1142efa-83e8-49a1-8675-095c20bfa2ba): created successfully Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebabbb86-d9ec-4e96-91bb-2ffe33b47485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (692651d9-ff5e-499c-8f58-758450e3b27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-43b3f532-3b23-4059-8071-605799811133 tempest-CreateVolumesFromImageTest-1614369105 None] Created volume successfully. Nov 06 21:29:27 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e 1073741824" returned: 0 in 0.571s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:27 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e Nov 06 21:29:27 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-299b80a8-5305-4fe1-9a3d-b50a747fabe2 req-00a9ee22-e2b1-459b-a101-d698d08a4d1b tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Terminate volume connection completed successfully. Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-299b80a8-5305-4fe1-9a3d-b50a747fabe2 req-00a9ee22-e2b1-459b-a101-d698d08a4d1b tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Deleting attachment ef8225bc-c93f-4f92-838c-dbad50330aa3. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:29:28 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e" returned: 0 in 0.316s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.145s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865451864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaa6321-dbe8-4217-9ac1-d5f5bcb598fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:03Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Creating volume acaa6321-dbe8-4217-9ac1-d5f5bcb598fd {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:28 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:28 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd 1073741824 Nov 06 21:29:28 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d956b4-2ee8-40ca-abe5-30c944eecd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe9f4df-3cdd-43aa-9ce1-4c3ea5b721f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Volume volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e (192aa4d8-659a-4c8b-b743-ce48a1d2350e): created successfully Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe9f4df-3cdd-43aa-9ce1-4c3ea5b721f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (50e57904-c9f1-4498-9748-935648cc7eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-89e9544b-d22b-4ccf-a54d-cf722d3ce46e tempest-CreateVolumesFromImageTest-1614369105 None] Created volume successfully. Nov 06 21:29:29 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd 1073741824" returned: 0 in 0.796s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd Nov 06 21:29:29 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Acquiring lock "cinder-10b8f383-d3b8-4433-9f68-55a4d3ec023e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "cinder-10b8f383-d3b8-4433-9f68-55a4d3ec023e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Acquiring lock "cinder-quobyte-10b8f383-d3b8-4433-9f68-55a4d3ec023e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "cinder-quobyte-10b8f383-d3b8-4433-9f68-55a4d3ec023e" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f556b7-6bee-4de3-a179-17247af0be78]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd" returned: 0 in 0.450s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.853s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241249826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d4c598-10f7-4783-8fe9-0e9a7d5e4968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b86b5c37d04e74b826041b1ecec2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:03Z,use_quota=True,user_id='5ab39c593b194d5fa3161134ddb97332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Creating volume 84d4c598-10f7-4783-8fe9-0e9a7d5e4968 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:29 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:29 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e Nov 06 21:29:29 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f975ca-cc49-43fa-9cc1-a51846cb1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49195f22-13d6-4f2d-aa63-debd8b99be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:29 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 1073741824 Nov 06 21:29:29 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Volume volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd (acaa6321-dbe8-4217-9ac1-d5f5bcb598fd): created successfully Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49195f22-13d6-4f2d-aa63-debd8b99be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (f7f0d759-0466-4014-ae03-968d694cb9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-09b7a1b4-4e54-427d-ac09-98fd5995b7a0 tempest-CreateVolumesFromImageTest-1614369105 None] Created volume successfully. Nov 06 21:29:30 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e" returned: 0 in 0.641s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e Nov 06 21:29:30 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 1073741824" returned: 0 in 0.698s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 Nov 06 21:29:30 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-10b8f383-d3b8-4433-9f68-55a4d3ec023e" returned: 0 in 0.445s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "cinder-quobyte-10b8f383-d3b8-4433-9f68-55a4d3ec023e" released by "delete_volume" :: held 1.159s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Created reservations ['801d53b4-4790-4a3a-85ab-2d9e50c73074', 'b2921cc0-74f1-42e5-9ccb-627a874c5b2f', 'c0809016-cd00-4844-b137-bb845efa5056', '6ce69127-2a24-4f9d-9c1f-6fd4b24d3c0e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-79207aef-da8d-44e8-9acb-3eab59895bb9 tempest-TestShelveInstance-201131307 None] Terminate volume connection completed successfully. Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-79207aef-da8d-44e8-9acb-3eab59895bb9 tempest-TestShelveInstance-201131307 None] Deleting attachment a1c33e6a-f3ed-47d6-b0e1-ae550781b9b3. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:30 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968" returned: 0 in 0.425s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.928s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:30 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:30 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9563e9-b3ee-4aab-8f8d-ccd7441b0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1623fdc-4c8a-4f0a-81f3-d2ff324c71b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[641e5ce4-603a-4cc4-b560-f31b9b96d4ea]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Volume volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 (84d4c598-10f7-4783-8fe9-0e9a7d5e4968): created successfully Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1623fdc-4c8a-4f0a-81f3-d2ff324c71b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Flow 'volume_create_manager' (1132bd56-15b1-43d7-8a71-e9ac4a72a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2bf68a8c-33ad-400d-9d6d-79a7ca726dd8 tempest-CreateVolumesFromImageTest-1614369105 None] Created volume successfully. Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Acquiring lock "cinder-1e4048b4-4199-486d-9975-87d8ae2b3a64-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Lock "cinder-1e4048b4-4199-486d-9975-87d8ae2b3a64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:30 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:29:30 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Acquiring lock "cinder-quobyte-1e4048b4-4199-486d-9975-87d8ae2b3a64" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Lock "cinder-quobyte-1e4048b4-4199-486d-9975-87d8ae2b3a64" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c006bc51-b7bc-46ea-9ec9-e1dedd2b1ff0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-84d4c598-10f7-4783-8fe9-0e9a7d5e4968-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.399s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Deleted volume successfully. Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-84d4c598-10f7-4783-8fe9-0e9a7d5e4968-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08db6169-4072-42c6-a998-b1c2e14cb172 tempest-TestServerVolumeAttachScenarioOldVersion-1741743014 None] Lock "cinder-10b8f383-d3b8-4433-9f68-55a4d3ec023e-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-quobyte-84d4c598-10f7-4783-8fe9-0e9a7d5e4968" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:31 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 Nov 06 21:29:31 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-84d4c598-10f7-4783-8fe9-0e9a7d5e4968" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bd7c37-5fc1-412b-9a13-0f5a957dbc93]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.516s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df1b16a-6068-4163-8703-dc61f7a1bc8b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 Nov 06 21:29:31 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:29:31 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64" returned: 0 in 0.507s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64 Nov 06 21:29:31 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968" returned: 0 in 0.619s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.582s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:31 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968 Nov 06 21:29:31 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:31 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img Nov 06 21:29:31 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:32 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1e4048b4-4199-486d-9975-87d8ae2b3a64" returned: 0 in 0.611s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:32 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:32 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Lock "cinder-quobyte-1e4048b4-4199-486d-9975-87d8ae2b3a64" released by "delete_volume" :: held 1.239s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.quota [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Created reservations ['c7f994d9-4e54-4f26-be49-cddcb8b87487', '05b8b52c-4120-4710-8f4f-ae774e4365bd', 'd9b41c75-9274-4a46-ba11-697cab64f9fb', '35aff75e-9b2b-4b75-986e-452d0e1fde41'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:32 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-84d4c598-10f7-4783-8fe9-0e9a7d5e4968" returned: 0 in 0.753s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-84d4c598-10f7-4783-8fe9-0e9a7d5e4968" released by "delete_volume" :: held 1.456s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:32 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.776s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:29:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:29:32 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:32 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Created reservations ['b1e27bc6-f5fe-4928-9a6f-ea44d5f50b50', 'a2541db1-378e-434c-9462-f83d9c080a1a', '5166cd0d-099c-4428-8eaf-4d5c23459f99', '87d9e522-7901-44ee-b86a-0109d5f56e88'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:33 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.538s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:33 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.manager [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:33 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Deleted volume successfully. Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [req-2b9edb07-e6b5-4b69-a492-e4f3886ffd93 req-d79ff0c7-4e7a-4d3a-bd06-36aa1777e5a7 tempest-TestShelveInstance-201131307 None] Lock "cinder-1e4048b4-4199-486d-9975-87d8ae2b3a64-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-quobyte-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:34 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0fd9a0-2d01-4748-b3ab-cdf0cf19fd87]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.753s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Deleted volume successfully. Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d80650be-c427-4577-a627-e9ac67d0afee tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-84d4c598-10f7-4783-8fe9-0e9a7d5e4968-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:34 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd Nov 06 21:29:34 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:34 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd" returned: 0 in 0.901s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:35 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd Nov 06 21:29:35 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:35 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd" returned: 0 in 0.696s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd" released by "delete_volume" :: held 1.725s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Created reservations ['f466eac0-6ad1-4174-8037-a1d21d7a6de9', '9b8a9927-4bfb-4eee-97ac-33f4363a8837', '69616662-e355-43b2-99f4-2c9a0b20ee2a', 'd61c4ed7-9bcd-4acc-bece-97b36f43dc29'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:36 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:36 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-192aa4d8-659a-4c8b-b743-ce48a1d2350e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-192aa4d8-659a-4c8b-b743-ce48a1d2350e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-quobyte-192aa4d8-659a-4c8b-b743-ce48a1d2350e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-192aa4d8-659a-4c8b-b743-ce48a1d2350e" acquired by "delete_volume" :: waited 0.061s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10375ac9-f371-4575-8750-4d1e1918c1e5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:36 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.716s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Deleted volume successfully. Nov 06 21:29:36 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e Nov 06 21:29:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cbc06baf-9c70-4208-9102-23c966fd2591 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-acaa6321-dbe8-4217-9ac1-d5f5bcb598fd-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:36 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:37 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e" returned: 0 in 0.744s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:37 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e Nov 06 21:29:37 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:37 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-192aa4d8-659a-4c8b-b743-ce48a1d2350e" returned: 0 in 0.576s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-192aa4d8-659a-4c8b-b743-ce48a1d2350e" released by "delete_volume" :: held 1.447s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Created reservations ['c31e6313-6384-4a59-b9b7-80354debcb01', 'cceb871f-50d7-4dcb-b68e-0c409518c8fd', 'a8ab1b38-16ee-40c4-a1ad-95caa09e5cb1', '93b20d49-3868-4816-a798-869c21bfc19f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:38 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:38 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:38 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.526s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Deleted volume successfully. Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-c1142efa-83e8-49a1-8675-095c20bfa2ba-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c4f9e7e5-c54b-46d4-8833-1c940773231c tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-192aa4d8-659a-4c8b-b743-ce48a1d2350e-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-c1142efa-83e8-49a1-8675-095c20bfa2ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-quobyte-c1142efa-83e8-49a1-8675-095c20bfa2ba" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-c1142efa-83e8-49a1-8675-095c20bfa2ba" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e0049d-f8f1-496c-a721-c45ad51c21a0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:39 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba Nov 06 21:29:39 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:39 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba" returned: 0 in 0.776s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:39 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba Nov 06 21:29:39 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:40 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c1142efa-83e8-49a1-8675-095c20bfa2ba" returned: 0 in 0.576s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-c1142efa-83e8-49a1-8675-095c20bfa2ba" released by "delete_volume" :: held 1.462s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Created reservations ['8b4f5b9b-5226-464b-9ac1-f699b30ec7e9', '00509114-028a-4e3d-85d7-12286494d5a0', 'f77151d1-ab1d-40ee-8ee1-0edb47e05280', '2be2f20d-9bb3-40d1-8b54-2c745b6057b2'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:40 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:40 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:41 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.533s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Deleted volume successfully. Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0185743e-85c6-4f97-86e2-971b27e81488 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-c1142efa-83e8-49a1-8675-095c20bfa2ba-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-e028d829-b31a-4c7a-bde3-373b6b675f46-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-e028d829-b31a-4c7a-bde3-373b6b675f46-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "cinder-quobyte-e028d829-b31a-4c7a-bde3-373b6b675f46" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-e028d829-b31a-4c7a-bde3-373b6b675f46" acquired by "delete_volume" :: waited 0.044s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c3d464-796e-4f3e-bba2-371d751936e9]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:41 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img" returned: 0 in 9.897s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd838d-19ce-4bd3-979d-947cb7377ba2]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:41 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 Nov 06 21:29:41 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:42 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:29:42 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:42 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46" returned: 0 in 0.615s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:42 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46 Nov 06 21:29:42 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:42 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.717s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:29:42 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Converted 1024.00 MB image at 103.45 MB/s Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] 3c783051-a1e5-4695-9126-24414d3a88c8 was raw, converting to qcow2 {{(pid=87350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1197}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6844fe6-2264-4a2c-946a-eec24e0318ff]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:42 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e028d829-b31a-4c7a-bde3-373b6b675f46" returned: 0 in 0.322s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-quobyte-e028d829-b31a-4c7a-bde3-373b6b675f46" released by "delete_volume" :: held 1.021s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:42 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img Nov 06 21:29:42 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Created reservations ['3f69eef3-ea2c-445b-af75-1caae58de61b', 'a44cf8b4-de6f-441e-8af1-387f6097f64c', '8480f022-2665-4b08-a545-77f301e3326f', 'c640651f-bc6c-460e-968f-b405baaa3139'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:43 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:43 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:43 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img" returned: 0 in 0.466s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:43 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img Nov 06 21:29:43 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:43 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.345s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Deleted volume successfully. Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eae0c3b3-afce-4046-8efb-d064d7c29c77 tempest-CreateVolumesFromImageTest-1614369105 None] Lock "cinder-e028d829-b31a-4c7a-bde3-373b6b675f46-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:43 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img" returned: 1 in 0.427s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:43 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2 Nov 06 21:29:43 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:43 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2" returned: 0 in 0.311s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Image conversion details: src /opt/stack/data/cinder/conversion/3cc7125d-2055-41a3-a72d-4f90137938fc.temp_image.3c783051-a1e5-4695-9126-24414d3a88c8n2r0nopa.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:29:43 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1720fc35-f794-4999-a939-8d202a067edb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:43 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2 Nov 06 21:29:43 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:44 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_eq1wpit2" returned: 0 in 0.459s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.259s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Uploaded volume to glance image-id: 3c783051-a1e5-4695-9126-24414d3a88c8. {{(pid=87350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1821}} Nov 06 21:29:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-505a3f57-ec41-4811-91b7-62b26fc2e007 tempest-VolumesActionsTest-737574812 None] Copy volume to image completed successfully. Nov 06 21:29:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Acquiring lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Acquiring lock "cinder-quobyte-3cc7125d-2055-41a3-a72d-4f90137938fc" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Lock "cinder-quobyte-3cc7125d-2055-41a3-a72d-4f90137938fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:29:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9957aa4-edf4-43c6-be8e-847b158999a0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:47 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:29:47 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:47 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.589s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:47 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc Nov 06 21:29:47 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:48 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3cc7125d-2055-41a3-a72d-4f90137938fc" returned: 0 in 0.364s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Lock "cinder-quobyte-3cc7125d-2055-41a3-a72d-4f90137938fc" released by "delete_volume" :: held 1.016s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Created reservations ['075c954d-f46c-45bb-86f5-47e5a34fac78', 'ef009013-469a-4e77-9a04-ef7d2357b87a', '6b8a5da5-c965-40ec-a58b-233bf82c0e00', '83efe33c-0306-4385-bfcd-0eb3177393b2'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:48 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:29:48 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:48 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.396s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:29:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Deleted volume successfully. Nov 06 21:29:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eab5c44a-8a17-4cb6-87e7-949303faefe2 tempest-VolumesActionsTest-737574812 None] Lock "cinder-3cc7125d-2055-41a3-a72d-4f90137938fc-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Flow 'volume_create_manager' (c0ddaea6-3b23-4293-9081-fc27dbf12848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ccec98-136a-4de8-940b-2f0a33c945ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ccec98-136a-4de8-940b-2f0a33c945ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11913661-fbb1-48bb-a18f-604fd0b5aa09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097ed1a08a96458188a484cb77a0e7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:52Z,use_quota=True,user_id='3adabe2ce53749d48623cc714f54bb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2a48bb-ac65-49b2-bfd2-72d6c0298fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2a48bb-ac65-49b2-bfd2-72d6c0298fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4588cb2f-ba0f-450f-a482-163bcd12eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4588cb2f-ba0f-450f-a482-163bcd12eba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11913661-fbb1-48bb-a18f-604fd0b5aa09', 'volume_name': 'volume-11913661-fbb1-48bb-a18f-604fd0b5aa09', 'volume_size': 1, 'image_id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/987541da-81cd-4d66-8623-dd4b508a1bb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb21253d10193ec60f4186c67ae22927', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '097ed1a08a96458188a484cb77a0e7ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a434a77a0e75292e34b95dd15106c4343c29da0d5e8125ffa075a07471a211f086b3c2a2dd06251a118b415a96f1024372efbd871f087c9ee6f8329e9b12047f', 'id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'created_at': datetime.datetime(2026, 11, 6, 20, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/987541da-81cd-4d66-8623-dd4b508a1bb4/file', 'properties': {}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60847180-728d-495a-aaaf-a9f6dbcd0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60847180-728d-495a-aaaf-a9f6dbcd0629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340745bf-9619-4432-ae6d-17ae6f0f3745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Volume 11913661-fbb1-48bb-a18f-604fd0b5aa09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11913661-fbb1-48bb-a18f-604fd0b5aa09', 'volume_size': 1, 'image_id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/987541da-81cd-4d66-8623-dd4b508a1bb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb21253d10193ec60f4186c67ae22927', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '097ed1a08a96458188a484cb77a0e7ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a434a77a0e75292e34b95dd15106c4343c29da0d5e8125ffa075a07471a211f086b3c2a2dd06251a118b415a96f1024372efbd871f087c9ee6f8329e9b12047f', 'id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'created_at': datetime.datetime(2026, 11, 6, 20, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/987541da-81cd-4d66-8623-dd4b508a1bb4/file', 'properties': {}}, 'image_service': } Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Trying to clone 11913661-fbb1-48bb-a18f-604fd0b5aa09 from image 987541da-81cd-4d66-8623-dd4b508a1bb4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/987541da-81cd-4d66-8623-dd4b508a1bb4', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:29:52 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:29:52 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7aa1b-444d-4268-8a28-99c26af66057]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:53 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD Nov 06 21:29:53 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:53 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:53 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD Nov 06 21:29:53 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:53 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD" returned: 1 in 0.521s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:29:53 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Temporary image 987541da-81cd-4d66-8623-dd4b508a1bb4 is fetched for user 3adabe2ce53749d48623cc714f54bb49. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f9dd5-4a7a-432e-b046-e115b17e9d8d]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:54 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD Nov 06 21:29:54 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:54 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:54 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD Nov 06 21:29:54 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:54 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:29:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11913661-fbb1-48bb-a18f-604fd0b5aa09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097ed1a08a96458188a484cb77a0e7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:52Z,use_quota=True,user_id='3adabe2ce53749d48623cc714f54bb49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Creating volume 11913661-fbb1-48bb-a18f-604fd0b5aa09 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:55 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:55 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 1073741824 Nov 06 21:29:55 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:55 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 1073741824" returned: 0 in 0.551s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:55 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 Nov 06 21:29:55 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:55 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09" returned: 0 in 0.391s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:56 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Attempting download of 987541da-81cd-4d66-8623-dd4b508a1bb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/987541da-81cd-4d66-8623-dd4b508a1bb4', 'metadata': {}}])) to volume 11913661-fbb1-48bb-a18f-604fd0b5aa09. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:29:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b66d33-9b82-4266-bc58-5e6b48e1f553]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:56 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq Nov 06 21:29:56 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:56 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq" returned: 0 in 0.530s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:56 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq Nov 06 21:29:56 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:57 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq" returned: 1 in 0.419s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_987541da-81cd-4d66-8623-dd4b508a1bb4_n1wvj5sq' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5a085c-4aef-4ffb-b7cc-1a19ecd51be9]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:57 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD Nov 06 21:29:57 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:57 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:57 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD Nov 06 21:29:57 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:57 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD" returned: 1 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] 987541da-81cd-4d66-8623-dd4b508a1bb4 was raw, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:29:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:58 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 Nov 06 21:29:58 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:58 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09" returned: 0 in 0.646s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_987541da-81cd-4d66-8623-dd4b508a1bb4_cd4yibl7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:29:58 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:58 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 1G Nov 06 21:29:58 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Flow 'volume_create_manager' (5082f3fd-10f5-4ca0-9f67-4608df377524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3468b2-a4b7-4f09-992a-cd3d80070829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3468b2-a4b7-4f09-992a-cd3d80070829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33784622-4c56-4805-b372-318c4c4ef3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648429d2b3254e5ea2e1a280162b73a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:59Z,use_quota=True,user_id='f331d75c82964daebee7c65a878f875e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b89f84-b526-4115-9d7f-69d360e61fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b89f84-b526-4115-9d7f-69d360e61fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e70ee0e-aeaa-431e-9b61-ce6063e940dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e70ee0e-aeaa-431e-9b61-ce6063e940dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33784622-4c56-4805-b372-318c4c4ef3f6', 'volume_name': 'volume-33784622-4c56-4805-b372-318c4c4ef3f6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43825d8-b740-41d4-a4a8-5cfaa859e5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43825d8-b740-41d4-a4a8-5cfaa859e5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bce8282-0182-4ac0-9d8e-de3e9fcd2c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Volume 33784622-4c56-4805-b372-318c4c4ef3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33784622-4c56-4805-b372-318c4c4ef3f6', 'volume_size': 1} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33784622-4c56-4805-b372-318c4c4ef3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648429d2b3254e5ea2e1a280162b73a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:29:59Z,use_quota=True,user_id='f331d75c82964daebee7c65a878f875e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Creating volume 33784622-4c56-4805-b372-318c4c4ef3f6 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:58 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:59 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 1073741824 Nov 06 21:29:59 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:59 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 1G" returned: 0 in 0.462s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Downloaded image 987541da-81cd-4d66-8623-dd4b508a1bb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/987541da-81cd-4d66-8623-dd4b508a1bb4', 'metadata': {}}])) to volume 11913661-fbb1-48bb-a18f-604fd0b5aa09 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Temporary image 987541da-81cd-4d66-8623-dd4b508a1bb4 for user 3adabe2ce53749d48623cc714f54bb49 is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Marking volume 11913661-fbb1-48bb-a18f-604fd0b5aa09 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Copying metadata from image 987541da-81cd-4d66-8623-dd4b508a1bb4 to 11913661-fbb1-48bb-a18f-604fd0b5aa09. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Creating volume glance metadata for volume 11913661-fbb1-48bb-a18f-604fd0b5aa09 backed by image 987541da-81cd-4d66-8623-dd4b508a1bb4 with: {'image_id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cb21253d10193ec60f4186c67ae22927', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340745bf-9619-4432-ae6d-17ae6f0f3745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11913661-fbb1-48bb-a18f-604fd0b5aa09', 'volume_size': 1, 'image_id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/987541da-81cd-4d66-8623-dd4b508a1bb4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb21253d10193ec60f4186c67ae22927', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '097ed1a08a96458188a484cb77a0e7ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a434a77a0e75292e34b95dd15106c4343c29da0d5e8125ffa075a07471a211f086b3c2a2dd06251a118b415a96f1024372efbd871f087c9ee6f8329e9b12047f', 'id': '987541da-81cd-4d66-8623-dd4b508a1bb4', 'created_at': datetime.datetime(2026, 11, 6, 20, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/987541da-81cd-4d66-8623-dd4b508a1bb4/file', 'properties': {}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b73ad0-a26a-4d81-be9b-5fa742438ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:59 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Volume volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 (11913661-fbb1-48bb-a18f-604fd0b5aa09): created successfully Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b73ad0-a26a-4d81-be9b-5fa742438ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Flow 'volume_create_manager' (c0ddaea6-3b23-4293-9081-fc27dbf12848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-239ed47b-6601-43ff-abd4-70364516afa1 tempest-VolumeImageDependencyTests-745287259 None] Created volume successfully. Nov 06 21:29:59 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 1073741824" returned: 0 in 0.572s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:59 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 Nov 06 21:29:59 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Flow 'volume_create_manager' (6a6bd66c-a562-4e99-b58d-426450e86030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1211f69b-eb8f-4efd-b25b-ecf6fca22551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1211f69b-eb8f-4efd-b25b-ecf6fca22551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-751118287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da9f35d-d9e6-41e9-8f8c-1648086e7a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cd362f7bc464096a9f23d76845a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:00Z,use_quota=True,user_id='403e62a9b5114cbb866a2605288628ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83127ae-da8e-4985-8824-987425a305c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83127ae-da8e-4985-8824-987425a305c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf4f3cd-3029-45fa-a5d1-eb787d53fb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf4f3cd-3029-45fa-a5d1-eb787d53fb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'volume_name': 'volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4be4bb-5ef9-4d3d-bc4c-c3b038209829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4be4bb-5ef9-4d3d-bc4c-c3b038209829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a53bb2a-11f7-40d0-b7bd-012c01462914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:29:59 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Volume 7da9f35d-d9e6-41e9-8f8c-1648086e7a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'volume_size': 1} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:59 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6" returned: 0 in 0.330s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-751118287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da9f35d-d9e6-41e9-8f8c-1648086e7a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cd362f7bc464096a9f23d76845a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:00Z,use_quota=True,user_id='403e62a9b5114cbb866a2605288628ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Creating volume 7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:29:59 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:29:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Acquiring lock "cinder-11913661-fbb1-48bb-a18f-604fd0b5aa09-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:29:59 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 1073741824 Nov 06 21:29:59 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bce8282-0182-4ac0-9d8e-de3e9fcd2c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33784622-4c56-4805-b372-318c4c4ef3f6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b9483-3487-417a-8f62-6c87391853f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Lock "cinder-11913661-fbb1-48bb-a18f-604fd0b5aa09-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Volume volume-33784622-4c56-4805-b372-318c4c4ef3f6 (33784622-4c56-4805-b372-318c4c4ef3f6): created successfully Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b9483-3487-417a-8f62-6c87391853f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Flow 'volume_create_manager' (5082f3fd-10f5-4ca0-9f67-4608df377524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-476079ae-bdb1-4f47-918c-c5169a632a10 tempest-CinderUnicodeTest-2146666914 None] Created volume successfully. Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Acquiring lock "cinder-quobyte-11913661-fbb1-48bb-a18f-604fd0b5aa09" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Lock "cinder-quobyte-11913661-fbb1-48bb-a18f-604fd0b5aa09" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871399f-c4aa-4d72-b326-c70ec714b232]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:00 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 Nov 06 21:30:00 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:00 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 1073741824" returned: 0 in 0.528s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:00 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 Nov 06 21:30:00 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:00 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:00 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09 Nov 06 21:30:00 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:00 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" returned: 0 in 0.336s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a53bb2a-11f7-40d0-b7bd-012c01462914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3561092f-4817-410b-a9ce-3b5f14ce8ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:00 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-11913661-fbb1-48bb-a18f-604fd0b5aa09" returned: 0 in 0.325s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Volume volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 (7da9f35d-d9e6-41e9-8f8c-1648086e7a73): created successfully Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3561092f-4817-410b-a9ce-3b5f14ce8ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Flow 'volume_create_manager' (6a6bd66c-a562-4e99-b58d-426450e86030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:00 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Lock "cinder-quobyte-11913661-fbb1-48bb-a18f-604fd0b5aa09" released by "delete_volume" :: held 0.848s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-44e1ba47-fcc3-4a0b-b4df-3fdecfc9c960 tempest-VolumesCloneTest-377654489 None] Created volume successfully. Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Created reservations ['4dea2f37-c635-43c1-8e28-56ce93be04f7', '0045ff8f-c702-401d-bdc5-43dc0e53bf27', '966e2460-f91d-4a87-a299-67d122dcb651', 'b2f15762-f225-4da2-a3fd-1bfedfec9266'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:01 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:30:01 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:01 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.333s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:01 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Deleted volume successfully. Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e0deb5cc-dc04-4521-b96e-8f75748f61b5 tempest-VolumeImageDependencyTests-745287259 None] Lock "cinder-11913661-fbb1-48bb-a18f-604fd0b5aa09-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Flow 'volume_create_manager' (1a85252c-1aa3-4d86-8d24-43899184d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37ac366-2d35-4347-988c-eb2aefef0698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37ac366-2d35-4347-988c-eb2aefef0698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-24796515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fda376a-7260-4435-a35b-b0543fa0d13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648429d2b3254e5ea2e1a280162b73a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:02Z,use_quota=True,user_id='f331d75c82964daebee7c65a878f875e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ac71be-78ad-47c9-89a7-0ab3ae666965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ac71be-78ad-47c9-89a7-0ab3ae666965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58584abd-ed46-4651-9719-3823b5512504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58584abd-ed46-4651-9719-3823b5512504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fda376a-7260-4435-a35b-b0543fa0d13e', 'volume_name': 'volume-4fda376a-7260-4435-a35b-b0543fa0d13e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9c62d6-ea06-4c61-a3e4-23ec682f7855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9c62d6-ea06-4c61-a3e4-23ec682f7855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79658dd1-2759-4925-be55-3edeb50183f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:01 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Volume 4fda376a-7260-4435-a35b-b0543fa0d13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fda376a-7260-4435-a35b-b0543fa0d13e', 'volume_size': 1} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-24796515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fda376a-7260-4435-a35b-b0543fa0d13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648429d2b3254e5ea2e1a280162b73a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:02Z,use_quota=True,user_id='f331d75c82964daebee7c65a878f875e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Creating volume 4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:01 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:30:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:01 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e 1073741824 Nov 06 21:30:01 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:02 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e 1073741824" returned: 0 in 0.667s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Flow 'volume_create_manager' (fe718948-24a0-40e1-bd0e-8d5ad7803027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11858b4-4c86-479b-9122-4ae314ac919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11858b4-4c86-479b-9122-4ae314ac919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1648079637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec570360-c2a0-4cb4-8bcb-ad320284f489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cd362f7bc464096a9f23d76845a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7da9f35d-d9e6-41e9-8f8c-1648086e7a73,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:02Z,use_quota=True,user_id='403e62a9b5114cbb866a2605288628ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd85317-f271-4ce3-abf6-6c8948544511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd85317-f271-4ce3-abf6-6c8948544511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0807f0-5c9d-43ee-aba5-1e8d5636ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0807f0-5c9d-43ee-aba5-1e8d5636ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ec570360-c2a0-4cb4-8bcb-ad320284f489', 'volume_name': 'volume-ec570360-c2a0-4cb4-8bcb-ad320284f489', 'volume_size': 2, 'source_volid': '7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'source_volstatus': 'available'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fbc23e-7c4e-4efe-bd99-b727ccbae130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:02 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e Nov 06 21:30:02 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fbc23e-7c4e-4efe-bd99-b727ccbae130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231d9dad-a8c6-4275-853c-f6018d9eff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Volume ec570360-c2a0-4cb4-8bcb-ad320284f489: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ec570360-c2a0-4cb4-8bcb-ad320284f489', 'volume_size': 2, 'source_volid': '7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'source_volstatus': 'available'} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:02 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e" returned: 0 in 0.379s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.303s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:02 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Cloning volume 7da9f35d-d9e6-41e9-8f8c-1648086e7a73 to volume ec570360-c2a0-4cb4-8bcb-ad320284f489 Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79658dd1-2759-4925-be55-3edeb50183f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fda376a-7260-4435-a35b-b0543fa0d13e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19de8259-4a4f-409e-9b5c-1902fb75b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Volume volume-4fda376a-7260-4435-a35b-b0543fa0d13e (4fda376a-7260-4435-a35b-b0543fa0d13e): created successfully Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19de8259-4a4f-409e-9b5c-1902fb75b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Flow 'volume_create_manager' (1a85252c-1aa3-4d86-8d24-43899184d76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Creating offline snapshot 5ecbda49-3949-4bfb-b5b0-b8d8c89df278 of volume 7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:30:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-01b7f654-bbbe-4b12-89b6-e558944e67b4 tempest-CinderUnicodeTest-2146666914 None] Created volume successfully. Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde1999-c7fa-4bb4-9d74-e633073f555c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:03 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 Nov 06 21:30:03 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:03 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" returned: 0 in 0.414s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:03 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 1G Nov 06 21:30:03 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:04 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 1G" returned: 0 in 0.702s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:04 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 Nov 06 21:30:04 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:04 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278" returned: 0 in 0.454s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:04 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 is being set with open permissions: ugo+rw Nov 06 21:30:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:04 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 Nov 06 21:30:04 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:04 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:05 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info Nov 06 21:30:05 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:05 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info" returned: 0 in 0.329s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:05 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info is being set with open permissions: ugo+rw Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:05 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info Nov 06 21:30:05 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:05 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.info" returned: 0 in 0.302s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Acquiring lock "cinder-quobyte-ec570360-c2a0-4cb4-8bcb-ad320284f489" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-ec570360-c2a0-4cb4-8bcb-ad320284f489" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] snapshot: 5ecbda49-3949-4bfb-b5b0-b8d8c89df278, volume: ec570360-c2a0-4cb4-8bcb-ad320284f489, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a4f6de-ca34-49ee-a203-941d85783d14]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:05 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 Nov 06 21:30:05 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:06 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278" returned: 0 in 0.427s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386bc29-37b2-4ce1-a7fe-8791253c755b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:06 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 Nov 06 21:30:06 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:06 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" returned: 0 in 0.460s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:30:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:06 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 Nov 06 21:30:06 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:14 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489" returned: 0 in 7.890s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:30:14 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Converted 1024.00 MB image at 129.77 MB/s Nov 06 21:30:14 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 is being set with open permissions: ugo+rw Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:14 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 Nov 06 21:30:14 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:14 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489" returned: 0 in 0.266s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-ec570360-c2a0-4cb4-8bcb-ad320284f489" released by "_copy_volume_from_snapshot" :: held 9.155s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Acquiring lock "cinder-quobyte-5ecbda49-3949-4bfb-b5b0-b8d8c89df278" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-5ecbda49-3949-4bfb-b5b0-b8d8c89df278" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Deleting offline snapshot 5ecbda49-3949-4bfb-b5b0-b8d8c89df278 of volume 7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] snapshot_file for this snap is: volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0344d5-d133-4caf-9cc3-1877377b34a4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:15 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=81,cinder:UPDATE=92,cinder:INSERT=32,cinder:DELETE=8 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:15 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 Nov 06 21:30:15 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:15 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278" returned: 0 in 0.452s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:30:15 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91471d6-1f26-4de9-907d-ffad4f91d25b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:15 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 Nov 06 21:30:15 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:16 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" returned: 0 in 0.604s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:16 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 Nov 06 21:30:16 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:16 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278" returned: 0 in 0.394s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:16 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278 Nov 06 21:30:16 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:16 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73.5ecbda49-3949-4bfb-b5b0-b8d8c89df278" returned: 0 in 0.335s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-5ecbda49-3949-4bfb-b5b0-b8d8c89df278" released by "_delete_snapshot" :: held 1.937s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=114,cinder:SELECT=75,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.958s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.761s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Creating offline snapshot 16f03772-7a8b-4817-81f0-ca406122ad18 of volume 4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231d9dad-a8c6-4275-853c-f6018d9eff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec570360-c2a0-4cb4-8bcb-ad320284f489', 'volume_size': 2, 'source_volid': '7da9f35d-d9e6-41e9-8f8c-1648086e7a73', 'source_volstatus': 'available'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f30483-5b3d-48ba-aa0e-5c84ca16ee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[98599b7e-6d81-4675-b2a0-146698c13254]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:16 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Volume volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 (ec570360-c2a0-4cb4-8bcb-ad320284f489): created successfully Nov 06 21:30:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f30483-5b3d-48ba-aa0e-5c84ca16ee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Flow 'volume_create_manager' (fe718948-24a0-40e1-bd0e-8d5ad7803027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:17 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1740aff6-f0ef-46ad-8a2c-3b23d8833737 tempest-VolumesCloneTest-377654489 None] Created volume successfully. Nov 06 21:30:17 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e Nov 06 21:30:17 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:17 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e" returned: 0 in 0.422s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:17 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 1G Nov 06 21:30:17 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 1G" returned: 0 in 0.627s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fda376a-7260-4435-a35b-b0543fa0d13e -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fda376a-7260-4435-a35b-b0543fa0d13e -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 Nov 06 21:30:18 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fda376a-7260-4435-a35b-b0543fa0d13e -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18" returned: 0 in 0.382s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:18 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 is being set with open permissions: ugo+rw Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 Nov 06 21:30:18 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Acquiring lock "cinder-ec570360-c2a0-4cb4-8bcb-ad320284f489-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Lock "cinder-ec570360-c2a0-4cb4-8bcb-ad320284f489-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Acquiring lock "cinder-quobyte-ec570360-c2a0-4cb4-8bcb-ad320284f489" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-ec570360-c2a0-4cb4-8bcb-ad320284f489" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ece019-afce-410b-9a3a-7663f644e5de]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18" returned: 0 in 0.373s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:18 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info Nov 06 21:30:18 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 Nov 06 21:30:18 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:18 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:19 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:19 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info is being set with open permissions: ugo+rw Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:19 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489" returned: 0 in 0.473s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:19 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info Nov 06 21:30:19 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:19 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489 Nov 06 21:30:19 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:19 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.info" returned: 0 in 0.327s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1a607d24-3c38-48ad-b74b-5c1e0faa2353 tempest-CinderUnicodeTest-2146666914 None] Create snapshot completed successfully Nov 06 21:30:19 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ec570360-c2a0-4cb4-8bcb-ad320284f489" returned: 0 in 0.398s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-ec570360-c2a0-4cb4-8bcb-ad320284f489" released by "delete_volume" :: held 0.954s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Created reservations ['d207b77e-0192-401c-9218-b38e3a9b05f8', 'f88fb598-ed4e-48de-abb0-a2a02ccdb4dd', '68144dfb-4f52-4b65-b77b-626160ff5c5a', 'df0eba5d-2179-4d48-b0eb-6bc0e3d00dea'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:19 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:30:19 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:20 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.322s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:20 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Deleted volume successfully. Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c2bc8f8d-4c4f-47da-ae10-a4bfd330492c tempest-VolumesCloneTest-377654489 None] Lock "cinder-ec570360-c2a0-4cb4-8bcb-ad320284f489-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-16f03772-7a8b-4817-81f0-ca406122ad18-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-16f03772-7a8b-4817-81f0-ca406122ad18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-quobyte-4fda376a-7260-4435-a35b-b0543fa0d13e" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-4fda376a-7260-4435-a35b-b0543fa0d13e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-quobyte-16f03772-7a8b-4817-81f0-ca406122ad18" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-16f03772-7a8b-4817-81f0-ca406122ad18" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Deleting offline snapshot 16f03772-7a8b-4817-81f0-ca406122ad18 of volume 4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] snapshot_file for this snap is: volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8df47-86f3-4ca9-b960-13633a5f5b7f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:20 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 Nov 06 21:30:20 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:20 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18" returned: 0 in 0.533s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fda376a-7260-4435-a35b-b0543fa0d13e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:30:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Acquiring lock "cinder-7da9f35d-d9e6-41e9-8f8c-1648086e7a73-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[330291c2-87a7-4549-94e2-829f39caa10b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Lock "cinder-7da9f35d-d9e6-41e9-8f8c-1648086e7a73-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Acquiring lock "cinder-quobyte-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:21 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e Nov 06 21:30:21 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b055d441-f7c9-4ade-803a-5cc327496411]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:21 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 Nov 06 21:30:21 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:21 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e" returned: 0 in 0.501s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:21 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 Nov 06 21:30:21 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:21 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" returned: 0 in 0.526s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:21 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73 Nov 06 21:30:21 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:22 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18" returned: 0 in 0.494s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:22 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18 Nov 06 21:30:22 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:22 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" returned: 0 in 0.375s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Lock "cinder-quobyte-7da9f35d-d9e6-41e9-8f8c-1648086e7a73" released by "delete_volume" :: held 0.992s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Created reservations ['a9340df9-39f9-4628-8e60-95f7b4d49022', '512e9cc9-beff-4d4c-9b20-658db5474979', 'de08c65d-7fbf-4a35-8c37-2d499a43f114', '9158e846-9699-4c4b-9ad3-86ac153f8597'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:22 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:30:22 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:22 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e.16f03772-7a8b-4817-81f0-ca406122ad18" returned: 0 in 0.448s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-16f03772-7a8b-4817-81f0-ca406122ad18" released by "_delete_snapshot" :: held 2.161s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-4fda376a-7260-4435-a35b-b0543fa0d13e" released by "delete_snapshot" :: held 2.193s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Created reservations ['b4242863-befc-424e-9ba2-81a051663dd0', '685ab10e-9411-41a1-b38d-046edae5ac39', '9408a7a0-ce37-427b-954e-f46d968fcda8', '9fd26877-5267-4497-9f5a-3ad77801afca'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:30:22 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.362s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Delete snapshot completed successfully. Nov 06 21:30:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Deleted volume successfully. Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-59de5e3a-123f-44e2-b381-89f37df0b342 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-16f03772-7a8b-4817-81f0-ca406122ad18-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-710d989b-c7c1-4501-a9c3-ae5a6fa0b885 tempest-VolumesCloneTest-377654489 None] Lock "cinder-7da9f35d-d9e6-41e9-8f8c-1648086e7a73-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-4fda376a-7260-4435-a35b-b0543fa0d13e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-4fda376a-7260-4435-a35b-b0543fa0d13e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-quobyte-4fda376a-7260-4435-a35b-b0543fa0d13e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-4fda376a-7260-4435-a35b-b0543fa0d13e" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:23 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8663fc-7acd-4404-993d-f3b6b6ca8079]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:23 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e Nov 06 21:30:23 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:24 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e" returned: 0 in 0.469s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:24 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e Nov 06 21:30:24 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:24 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4fda376a-7260-4435-a35b-b0543fa0d13e" returned: 0 in 0.294s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-4fda376a-7260-4435-a35b-b0543fa0d13e" released by "delete_volume" :: held 0.857s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Created reservations ['cae0aa42-b2cf-4ed1-a825-b64699fd0bec', '43ea93c3-470c-46bd-a261-2f3a68e171a1', 'd0579686-312c-4661-9c44-4a367867b761', '7cfc017e-7593-4fa8-958a-41b70822f0b7'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:24 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:30:24 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-33784622-4c56-4805-b372-318c4c4ef3f6-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-33784622-4c56-4805-b372-318c4c4ef3f6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "cinder-quobyte-33784622-4c56-4805-b372-318c4c4ef3f6" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:30:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-33784622-4c56-4805-b372-318c4c4ef3f6" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b622c43-2552-4ca1-be44-7829db224ca7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:25 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.334s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:25 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 Nov 06 21:30:25 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Deleted volume successfully. Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-08d996b0-06d0-4ec3-86ef-e357626b5661 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-4fda376a-7260-4435-a35b-b0543fa0d13e-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:25 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:25 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6 Nov 06 21:30:25 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:25 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33784622-4c56-4805-b372-318c4c4ef3f6" returned: 0 in 0.264s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-quobyte-33784622-4c56-4805-b372-318c4c4ef3f6" released by "delete_volume" :: held 0.752s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Created reservations ['58836a94-0196-483a-99e2-0619232e5d2e', '69e966da-4a12-494b-b79f-7f2a3be6ee65', 'a4d10745-93ef-48a5-a4ed-2ec64d0f6e42', 'b37749d5-e2b4-41e1-a63b-c99362297583'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:25 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:30:25 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:26 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:26 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:26 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Deleted volume successfully. Nov 06 21:30:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-15a5418d-79f0-4116-9e9e-be02786c4dd4 tempest-CinderUnicodeTest-2146666914 None] Lock "cinder-33784622-4c56-4805-b372-318c4c4ef3f6-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Flow 'volume_create_manager' (6448146a-934c-4196-86fe-9bddc3ac19e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b739ca59-d659-4173-b781-58dde0a51d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b739ca59-d659-4173-b781-58dde0a51d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-644332523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76999fd5-de9a-4edc-b0e6-2ff4696992bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13363d24adc2495b87299e727e48916e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:29Z,use_quota=True,user_id='1120866f4e9c437180f31ed36ca838ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c45de11-b797-49fd-86ee-78798896af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c45de11-b797-49fd-86ee-78798896af9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7dac60-b265-4a60-92f9-ec43670dd9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7dac60-b265-4a60-92f9-ec43670dd9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76999fd5-de9a-4edc-b0e6-2ff4696992bd', 'volume_name': 'volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8aa218-c9e5-475a-b3ce-64c2d9224468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8aa218-c9e5-475a-b3ce-64c2d9224468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110e3eec-f7fb-42d2-86d1-19f614405acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Volume 76999fd5-de9a-4edc-b0e6-2ff4696992bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd', 'volume_size': 1} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-644332523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76999fd5-de9a-4edc-b0e6-2ff4696992bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13363d24adc2495b87299e727e48916e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:29Z,use_quota=True,user_id='1120866f4e9c437180f31ed36ca838ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Creating volume 76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:30:29 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:29 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd 1073741824 Nov 06 21:30:29 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:29 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd 1073741824" returned: 0 in 0.759s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:30 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd Nov 06 21:30:30 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:30 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd" returned: 0 in 0.336s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110e3eec-f7fb-42d2-86d1-19f614405acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5885b353-f814-4ca3-a3a8-20bd235f196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Volume volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd (76999fd5-de9a-4edc-b0e6-2ff4696992bd): created successfully Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5885b353-f814-4ca3-a3a8-20bd235f196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Flow 'volume_create_manager' (6448146a-934c-4196-86fe-9bddc3ac19e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-395b64a6-0ff7-4fba-a04e-389984a012ce tempest-TestImageHashVerification-273484467 None] Created volume successfully. Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:32 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:30:32 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:32 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.474s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81831e0-3ee5-4586-90d5-99d44ad79578]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:32 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd Nov 06 21:30:32 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Flow 'volume_create_manager' (87f3e4fb-4abc-4c74-bce6-9b56614b4f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f0b570-7cf3-4eb5-bf9c-2e9ac1bae752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f0b570-7cf3-4eb5-bf9c-2e9ac1bae752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-122130031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d208045-efae-440c-b985-ce52c7d131ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32dc79865f1c4307bd48b1619a35fe0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:33Z,use_quota=True,user_id='4fb3b9dff0cc4bee9ea98d23eb370e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d7a0ed-c684-4bdc-aa62-6251cfc8ac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d7a0ed-c684-4bdc-aa62-6251cfc8ac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0344d8-854e-473e-99de-c1a1d1ff7374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0344d8-854e-473e-99de-c1a1d1ff7374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d208045-efae-440c-b985-ce52c7d131ce', 'volume_name': 'volume-2d208045-efae-440c-b985-ce52c7d131ce', 'volume_size': 2}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d1730f-c3f7-4f7e-8ce8-3518002c5150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d1730f-c3f7-4f7e-8ce8-3518002c5150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9123617-a389-444e-bc0b-beaee9c00d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:33 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Volume 2d208045-efae-440c-b985-ce52c7d131ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d208045-efae-440c-b985-ce52c7d131ce', 'volume_size': 2} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:33 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd" returned: 0 in 0.591s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb50004-7f3b-4f2b-b0b3-d8ace78055ed]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:33 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd Nov 06 21:30:33 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:33 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd" returned: 0 in 0.448s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd /opt/stack/data/cinder/conversion/76999fd5-de9a-4edc-b0e6-2ff4696992bd.temp_image.05353c5a-d418-4037-a76c-6c24b1db6ec4o7w9zqy5.img {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:33 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd /opt/stack/data/cinder/conversion/76999fd5-de9a-4edc-b0e6-2ff4696992bd.temp_image.05353c5a-d418-4037-a76c-6c24b1db6ec4o7w9zqy5.img Nov 06 21:30:33 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Flow 'volume_create_manager' (f43bfba0-d801-4d67-93bc-77eaa626d8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c0356b-52c4-4cc4-8cfa-85113280b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c0356b-52c4-4cc4-8cfa-85113280b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383202673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa1ef23-b808-4332-bd37-92b8c69b8425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95323bc8ede43e8859fe7c5938715d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:34Z,use_quota=True,user_id='188595743081473aa6358b09fdac149f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66419ed9-646b-43f6-a36c-1554f89f0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66419ed9-646b-43f6-a36c-1554f89f0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b4b2aa-d079-4a16-bc5b-be3af393dea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b4b2aa-d079-4a16-bc5b-be3af393dea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa1ef23-b808-4332-bd37-92b8c69b8425', 'volume_name': 'volume-5fa1ef23-b808-4332-bd37-92b8c69b8425', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a693ed-a60f-4641-9acb-3aad9aefbf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a693ed-a60f-4641-9acb-3aad9aefbf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3c327c-3690-4991-ae96-8b0cdfbed197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:34 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Volume 5fa1ef23-b808-4332-bd37-92b8c69b8425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa1ef23-b808-4332-bd37-92b8c69b8425', 'volume_size': 1} Nov 06 21:30:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:41 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd /opt/stack/data/cinder/conversion/76999fd5-de9a-4edc-b0e6-2ff4696992bd.temp_image.05353c5a-d418-4037-a76c-6c24b1db6ec4o7w9zqy5.img" returned: 0 in 7.638s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:41 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a638b-475a-4f83-8944-1f041a1d5109]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:30:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:30:41 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd Nov 06 21:30:41 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:30:42 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd" returned: 0 in 0.649s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/conversion/76999fd5-de9a-4edc-b0e6-2ff4696992bd.temp_image.05353c5a-d418-4037-a76c-6c24b1db6ec4o7w9zqy5.img {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:30:42 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Converted 1024.00 MB image at 134.01 MB/s Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] 05353c5a-d418-4037-a76c-6c24b1db6ec4 was raw, no need to convert to raw {{(pid=87350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Flow 'volume_create_manager' (59686b61-60dd-4bd2-aada-06e89503c60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa90dbcd-6297-4855-aae1-f7e10f6a1cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa90dbcd-6297-4855-aae1-f7e10f6a1cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-48998069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d02349b-2f66-4e87-863f-e99d83871b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93361edbd3d14c27adbf424ec845a2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:43Z,use_quota=True,user_id='9e2211e97aa949fabd767497e3fea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a624336e-0609-46b7-8e53-8b2f2b1066c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a624336e-0609-46b7-8e53-8b2f2b1066c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e083817a-d048-47df-89e5-4ef86e73c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e083817a-d048-47df-89e5-4ef86e73c015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d02349b-2f66-4e87-863f-e99d83871b10', 'volume_name': 'volume-9d02349b-2f66-4e87-863f-e99d83871b10', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d51731-98b8-49a3-80c2-e6f92c64dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d51731-98b8-49a3-80c2-e6f92c64dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3344545f-df28-475f-bbee-04e568fb17da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:30:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Volume 9d02349b-2f66-4e87-863f-e99d83871b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d02349b-2f66-4e87-863f-e99d83871b10', 'volume_size': 1} Nov 06 21:30:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:30:52 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=50,cinder:SELECT=30,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:30:52 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=42,cinder:SELECT=43,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.905s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Uploaded volume to glance image-id: 05353c5a-d418-4037-a76c-6c24b1db6ec4. {{(pid=87350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1821}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.515s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-122130031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d208045-efae-440c-b985-ce52c7d131ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32dc79865f1c4307bd48b1619a35fe0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:33Z,use_quota=True,user_id='4fb3b9dff0cc4bee9ea98d23eb370e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Creating volume 2d208045-efae-440c-b985-ce52c7d131ce {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:00 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce 2147483648 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:00 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce 2147483648 Nov 06 21:31:00 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0e31b412-4d6e-4f80-966d-a761aad7632a tempest-TestImageHashVerification-273484467 None] Copy volume to image completed successfully. Nov 06 21:31:01 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce 2147483648" returned: 0 in 0.513s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:01 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce Nov 06 21:31:01 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Acquiring lock "cinder-76999fd5-de9a-4edc-b0e6-2ff4696992bd-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Lock "cinder-76999fd5-de9a-4edc-b0e6-2ff4696992bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:01 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce" returned: 0 in 0.281s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.871s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383202673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa1ef23-b808-4332-bd37-92b8c69b8425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95323bc8ede43e8859fe7c5938715d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:34Z,use_quota=True,user_id='188595743081473aa6358b09fdac149f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Creating volume 5fa1ef23-b808-4332-bd37-92b8c69b8425 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:01 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:01 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 1073741824 Nov 06 21:31:01 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9123617-a389-444e-bc0b-beaee9c00d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d208045-efae-440c-b985-ce52c7d131ce', 'volume_size': 2}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5f0055-74fb-4374-b006-303cfe926b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Acquiring lock "cinder-quobyte-76999fd5-de9a-4edc-b0e6-2ff4696992bd" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:01 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Volume volume-2d208045-efae-440c-b985-ce52c7d131ce (2d208045-efae-440c-b985-ce52c7d131ce): created successfully Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5f0055-74fb-4374-b006-303cfe926b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Flow 'volume_create_manager' (87f3e4fb-4abc-4c74-bce6-9b56614b4f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Lock "cinder-quobyte-76999fd5-de9a-4edc-b0e6-2ff4696992bd" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:01 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a91bf46f-cc84-401e-beb1-cedf85ab25ae tempest-VolumesCloneNegativeTest-1447004065 None] Created volume successfully. Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecddbc8-7cdf-4e8a-ba1f-9fffb85cc9bb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:01 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd Nov 06 21:31:01 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:01 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 1073741824" returned: 0 in 0.496s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:01 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 Nov 06 21:31:01 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:01 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd" returned: 0 in 0.470s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:02 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd Nov 06 21:31:02 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Acquiring lock "cinder-2d208045-efae-440c-b985-ce52c7d131ce-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Lock "cinder-2d208045-efae-440c-b985-ce52c7d131ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Acquiring lock "cinder-quobyte-2d208045-efae-440c-b985-ce52c7d131ce" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Lock "cinder-quobyte-2d208045-efae-440c-b985-ce52c7d131ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fabf3b-114b-48e6-846a-e353b877bff5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:02 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425" returned: 0 in 0.313s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.352s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-48998069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d02349b-2f66-4e87-863f-e99d83871b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93361edbd3d14c27adbf424ec845a2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:30:43Z,use_quota=True,user_id='9e2211e97aa949fabd767497e3fea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Creating volume 9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:02 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:02 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-76999fd5-de9a-4edc-b0e6-2ff4696992bd" returned: 0 in 0.305s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 1073741824 Nov 06 21:31:02 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Lock "cinder-quobyte-76999fd5-de9a-4edc-b0e6-2ff4696992bd" released by "delete_volume" :: held 0.826s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3c327c-3690-4991-ae96-8b0cdfbed197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa1ef23-b808-4332-bd37-92b8c69b8425', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162a8d23-23d6-457b-8b3d-41f8be891db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:02 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce Nov 06 21:31:02 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Volume volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 (5fa1ef23-b808-4332-bd37-92b8c69b8425): created successfully Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162a8d23-23d6-457b-8b3d-41f8be891db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Flow 'volume_create_manager' (f43bfba0-d801-4d67-93bc-77eaa626d8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ae05aabf-85d0-4e19-8122-15547e649cb2 tempest-ProjectReaderTests-1887172362 None] Created volume successfully. Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Created reservations ['9bf3ea9b-6256-4548-a86d-a3d4bbccffb9', 'b341dd56-5b02-4fd9-83d7-b1a08d804e16', 'bd6bf229-6fce-4f8b-b1f9-b29d038caf0d', '4f52cdd7-5eac-4421-bf46-6aaf50bc364a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:02 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:02 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce" returned: 0 in 0.468s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:02 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce Nov 06 21:31:02 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.278s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Deleted volume successfully. Nov 06 21:31:02 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 1073741824" returned: 0 in 0.531s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-57cdf5bb-0788-444e-abd4-4f00597ea0cf tempest-TestImageHashVerification-273484467 None] Lock "cinder-76999fd5-de9a-4edc-b0e6-2ff4696992bd-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:02 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 Nov 06 21:31:02 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:02 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d208045-efae-440c-b985-ce52c7d131ce" returned: 0 in 0.274s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Lock "cinder-quobyte-2d208045-efae-440c-b985-ce52c7d131ce" released by "delete_volume" :: held 0.808s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Created reservations ['5e9053ec-b99f-48d8-afb8-58304340c5b4', '96ca79b8-ebd2-4a9a-87ab-0232ffc1512b', '6c496c23-3fd5-4829-84c4-cae37e2f802c', 'bbf17ef7-aa12-4794-93d9-e72d89570e5d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:03 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:03 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:03 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3344545f-df28-475f-bbee-04e568fb17da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d02349b-2f66-4e87-863f-e99d83871b10', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6699067-a63d-445e-bb4d-0d9463cae590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:03 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Volume volume-9d02349b-2f66-4e87-863f-e99d83871b10 (9d02349b-2f66-4e87-863f-e99d83871b10): created successfully Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6699067-a63d-445e-bb4d-0d9463cae590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Flow 'volume_create_manager' (59686b61-60dd-4bd2-aada-06e89503c60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d25a1b21-47d5-4c39-8cd2-239067ff19fa tempest-SnapshotDependencyTests-1389651013 None] Created volume successfully. Nov 06 21:31:03 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.256s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Deleted volume successfully. Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-edfd5142-fe51-4892-ab04-ba9054b91199 tempest-VolumesCloneNegativeTest-1447004065 None] Lock "cinder-2d208045-efae-440c-b985-ce52c7d131ce-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "cinder-5fa1ef23-b808-4332-bd37-92b8c69b8425-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-5fa1ef23-b808-4332-bd37-92b8c69b8425-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "cinder-quobyte-5fa1ef23-b808-4332-bd37-92b8c69b8425" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-quobyte-5fa1ef23-b808-4332-bd37-92b8c69b8425" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d67f5d5-4fdb-492e-acbc-f791297a7713]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:03 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 Nov 06 21:31:03 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:04 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:04 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425 Nov 06 21:31:04 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Creating offline snapshot c5dcf329-7581-4943-8dbe-cd3f8e0dadfe of volume 9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:31:04 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-5fa1ef23-b808-4332-bd37-92b8c69b8425" returned: 0 in 0.412s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d611e454-0670-449d-a0ee-81e4ac4407a7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-quobyte-5fa1ef23-b808-4332-bd37-92b8c69b8425" released by "delete_volume" :: held 0.908s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Created reservations ['ce8e8c9b-d0ca-4423-a976-78bfe9d98eca', 'b6ab546c-6062-428b-b2f7-0d15aca44c6f', '8762068d-9e5a-4b30-ad19-ab95aa60d7c9', '805ab01f-077a-4902-ab24-77b6542d27c1'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:04 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 Nov 06 21:31:04 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:04 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:04 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:05 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10" returned: 0 in 0.510s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:05 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe 1G Nov 06 21:31:05 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:05 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.302s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Deleted volume successfully. Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cc36a1cf-d0d6-4b49-b145-484394a03541 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-5fa1ef23-b808-4332-bd37-92b8c69b8425-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:05 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe 1G" returned: 0 in 0.512s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d02349b-2f66-4e87-863f-e99d83871b10 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:05 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d02349b-2f66-4e87-863f-e99d83871b10 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe Nov 06 21:31:05 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:05 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d02349b-2f66-4e87-863f-e99d83871b10 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:05 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe is being set with open permissions: ugo+rw Nov 06 21:31:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:06 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe Nov 06 21:31:06 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:06 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" returned: 0 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:06 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info Nov 06 21:31:06 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Flow 'volume_create_manager' (f7908699-a566-4405-bfff-7e9a8f74e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5fa0b6-76b3-4c72-8141-6ea629fc51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5fa0b6-76b3-4c72-8141-6ea629fc51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-381715412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9007129-a14d-46ac-a14f-0e3c5af030ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95323bc8ede43e8859fe7c5938715d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:06Z,use_quota=True,user_id='188595743081473aa6358b09fdac149f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204c61e5-a0dc-4d1d-8847-15c26a706708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204c61e5-a0dc-4d1d-8847-15c26a706708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306f6cce-465d-4fcb-9e1e-ce6ff7770b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306f6cce-465d-4fcb-9e1e-ce6ff7770b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9007129-a14d-46ac-a14f-0e3c5af030ba', 'volume_name': 'volume-d9007129-a14d-46ac-a14f-0e3c5af030ba', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7967d6-7371-40ba-b870-4e4903cde9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7967d6-7371-40ba-b870-4e4903cde9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9907883-a00b-4725-9354-4e75f421d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:06 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Volume d9007129-a14d-46ac-a14f-0e3c5af030ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9007129-a14d-46ac-a14f-0e3c5af030ba', 'volume_size': 1} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:06 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info" returned: 0 in 0.299s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:06 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info is being set with open permissions: ugo+rw Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:06 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info Nov 06 21:31:06 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:06 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.info" returned: 0 in 0.307s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-381715412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9007129-a14d-46ac-a14f-0e3c5af030ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95323bc8ede43e8859fe7c5938715d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:06Z,use_quota=True,user_id='188595743081473aa6358b09fdac149f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Creating volume d9007129-a14d-46ac-a14f-0e3c5af030ba {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:06 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:07 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba 1073741824 Nov 06 21:31:07 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-639a1821-4513-49b2-84c7-38a640ebf73e tempest-SnapshotDependencyTests-1389651013 None] Create snapshot completed successfully Nov 06 21:31:07 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba 1073741824" returned: 0 in 0.467s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:07 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba Nov 06 21:31:07 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:07 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba" returned: 0 in 0.305s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9907883-a00b-4725-9354-4e75f421d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9007129-a14d-46ac-a14f-0e3c5af030ba', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a7ba4-0da2-4ae1-8677-4183bfa6c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:07 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Volume volume-d9007129-a14d-46ac-a14f-0e3c5af030ba (d9007129-a14d-46ac-a14f-0e3c5af030ba): created successfully Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4a7ba4-0da2-4ae1-8677-4183bfa6c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Flow 'volume_create_manager' (f7908699-a566-4405-bfff-7e9a8f74e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5ae72c99-c142-4881-96fd-ab7f473dbf4d tempest-ProjectReaderTests-1887172362 None] Created volume successfully. Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Flow 'volume_create_manager' (f8b20ebb-c9f6-4f88-83e2-897b2e9f51c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1352ca2e-7ad8-4ad2-909f-5719451a0a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1352ca2e-7ad8-4ad2-909f-5719451a0a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930e0d44-d3c7-440a-91d1-7439b68b7187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93361edbd3d14c27adbf424ec845a2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5dcf329-7581-4943-8dbe-cd3f8e0dadfe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:08Z,use_quota=True,user_id='9e2211e97aa949fabd767497e3fea480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c58f09f-1540-447f-bc0b-b985166931fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c58f09f-1540-447f-bc0b-b985166931fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e44a11a-8cc1-4f8f-970f-bbd8d141cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e44a11a-8cc1-4f8f-970f-bbd8d141cb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '930e0d44-d3c7-440a-91d1-7439b68b7187', 'volume_name': 'volume-930e0d44-d3c7-440a-91d1-7439b68b7187', 'volume_size': 1, 'snapshot_id': 'c5dcf329-7581-4943-8dbe-cd3f8e0dadfe'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956fc649-d1e9-442d-9b8a-d1db76addea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956fc649-d1e9-442d-9b8a-d1db76addea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602f185a-9794-4772-9b41-1ac918b276a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:08 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Volume 930e0d44-d3c7-440a-91d1-7439b68b7187: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-930e0d44-d3c7-440a-91d1-7439b68b7187', 'volume_size': 1, 'snapshot_id': 'c5dcf329-7581-4943-8dbe-cd3f8e0dadfe'} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "cinder-d9007129-a14d-46ac-a14f-0e3c5af030ba-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-quobyte-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe-930e0d44-d3c7-440a-91d1-7439b68b7187" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-d9007129-a14d-46ac-a14f-0e3c5af030ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe-930e0d44-d3c7-440a-91d1-7439b68b7187" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Creating volume 930e0d44-d3c7-440a-91d1-7439b68b7187 from snapshot c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-quobyte-930e0d44-d3c7-440a-91d1-7439b68b7187" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "cinder-quobyte-d9007129-a14d-46ac-a14f-0e3c5af030ba" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-930e0d44-d3c7-440a-91d1-7439b68b7187" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] snapshot: c5dcf329-7581-4943-8dbe-cd3f8e0dadfe, volume: 930e0d44-d3c7-440a-91d1-7439b68b7187, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-quobyte-d9007129-a14d-46ac-a14f-0e3c5af030ba" acquired by "delete_volume" :: waited 0.068s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e7de5a-c041-463f-a599-9fd92efeed5d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad11b65-a3b9-4d56-9c36-03a6cfaafdc3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:09 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba Nov 06 21:31:09 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:09 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe Nov 06 21:31:09 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:09 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba" returned: 0 in 0.476s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:09 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba Nov 06 21:31:09 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:09 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" returned: 0 in 0.653s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d02349b-2f66-4e87-863f-e99d83871b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c8bae-ea1b-49a3-9b97-68b30ab88d5a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:09 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 Nov 06 21:31:09 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:09 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-d9007129-a14d-46ac-a14f-0e3c5af030ba" returned: 0 in 0.348s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-quobyte-d9007129-a14d-46ac-a14f-0e3c5af030ba" released by "delete_volume" :: held 0.892s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Created reservations ['88ab8e9a-da0e-4ecd-a4b0-eabad874bd32', '2eeef703-3d1a-432e-a973-8cce74cef652', 'ae190705-a0cc-418d-8316-a2147ad4218a', 'e4888cf7-693a-4479-adb9-7a7ea22c23de'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:09 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:09 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:09 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10" returned: 0 in 0.463s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:10 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 Nov 06 21:31:10 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:10 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.329s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:10 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Deleted volume successfully. Nov 06 21:31:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-62b9c479-60ff-458e-a5a1-47a419c9d159 tempest-ProjectReaderTests-1887172362 None] Lock "cinder-d9007129-a14d-46ac-a14f-0e3c5af030ba-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:18 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187" returned: 0 in 8.845s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:18 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10, size 1024.00 MB, duration 8.85 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:31:18 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Converted 1024.00 MB image at 115.76 MB/s Nov 06 21:31:18 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 is being set with open permissions: ugo+rw Nov 06 21:31:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:18 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 Nov 06 21:31:18 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:19 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187" returned: 0 in 0.358s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-930e0d44-d3c7-440a-91d1-7439b68b7187" released by "_copy_volume_from_snapshot" :: held 10.471s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe-930e0d44-d3c7-440a-91d1-7439b68b7187" released by "_create_volume_from_snapshot" :: held 10.598s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.632s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602f185a-9794-4772-9b41-1ac918b276a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930e0d44-d3c7-440a-91d1-7439b68b7187', 'volume_size': 1, 'snapshot_id': 'c5dcf329-7581-4943-8dbe-cd3f8e0dadfe'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19938537-ac29-4825-9913-f389c986ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:19 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Volume volume-930e0d44-d3c7-440a-91d1-7439b68b7187 (930e0d44-d3c7-440a-91d1-7439b68b7187): created successfully Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19938537-ac29-4825-9913-f389c986ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Flow 'volume_create_manager' (f8b20ebb-c9f6-4f88-83e2-897b2e9f51c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:19 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-34e0e4e0-d068-4e58-b402-c48d7b000f33 tempest-SnapshotDependencyTests-1389651013 None] Created volume successfully. Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-quobyte-9d02349b-2f66-4e87-863f-e99d83871b10" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-9d02349b-2f66-4e87-863f-e99d83871b10" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-quobyte-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:19 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Deleting offline snapshot c5dcf329-7581-4943-8dbe-cd3f8e0dadfe of volume 9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] snapshot_file for this snap is: volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fc1ab4-1d5a-402b-8d8a-95a7a1a92ed2]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:20 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe Nov 06 21:31:20 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:20 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" returned: 0 in 0.610s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d02349b-2f66-4e87-863f-e99d83871b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c8489-ded2-43ad-afa6-8afa58d497d6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:20 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 Nov 06 21:31:20 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:21 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10" returned: 0 in 0.790s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:21 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe Nov 06 21:31:21 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:21 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" returned: 0 in 0.495s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:22 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe Nov 06 21:31:22 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (0e6ec833-20b9-45de-9bf1-e1d52ba9c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f6530a-e6c5-4c89-8b00-93fe55bb8de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f6530a-e6c5-4c89-8b00-93fe55bb8de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714480152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f190f40e-02b9-40f8-9bd5-bed9dea4297a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:22Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b138e01-0b54-4927-997e-3e8dd3fd8119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b138e01-0b54-4927-997e-3e8dd3fd8119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd7f544-7bb0-4b17-b931-3713fe4fdd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd7f544-7bb0-4b17-b931-3713fe4fdd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f190f40e-02b9-40f8-9bd5-bed9dea4297a', 'volume_name': 'volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc0eac3-30d2-4098-813c-f88fb3f0ceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc0eac3-30d2-4098-813c-f88fb3f0ceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52622069-6516-4682-95c3-a6a12611bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:22 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Volume f190f40e-02b9-40f8-9bd5-bed9dea4297a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a', 'volume_size': 1} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714480152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f190f40e-02b9-40f8-9bd5-bed9dea4297a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:22Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Creating volume f190f40e-02b9-40f8-9bd5-bed9dea4297a {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:22 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:22 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a 1073741824 Nov 06 21:31:22 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:22 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10.c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" returned: 0 in 0.469s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe" released by "_delete_snapshot" :: held 2.572s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-9d02349b-2f66-4e87-863f-e99d83871b10" released by "delete_snapshot" :: held 2.620s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Created reservations ['68b1965c-5f0a-47d8-a35f-157373116710', '5f9fd683-65e5-4c60-ba9e-d7362e149a54', 'e0735c6d-5c7e-4535-8651-8d5d258396bf', '109f9d42-c4b6-479d-9a72-e834629ca1c4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:22 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Delete snapshot completed successfully. Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9f1bb3de-9fda-4460-b9b4-ab9f517d039d tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-c5dcf329-7581-4943-8dbe-cd3f8e0dadfe-delete_snapshot" released by "delete_snapshot" :: held 2.971s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:22 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a 1073741824" returned: 0 in 0.617s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:22 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a Nov 06 21:31:22 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-9d02349b-2f66-4e87-863f-e99d83871b10-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-9d02349b-2f66-4e87-863f-e99d83871b10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-quobyte-9d02349b-2f66-4e87-863f-e99d83871b10" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-9d02349b-2f66-4e87-863f-e99d83871b10" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:23 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a" returned: 0 in 0.511s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52622069-6516-4682-95c3-a6a12611bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6faf367-0950-410d-9b56-9585416811f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c951a896-5366-4974-b735-42a44ae358bf]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:23 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Volume volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a (f190f40e-02b9-40f8-9bd5-bed9dea4297a): created successfully Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6faf367-0950-410d-9b56-9585416811f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (0e6ec833-20b9-45de-9bf1-e1d52ba9c66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:23 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5011ebb9-12a5-42d9-8841-2536a1729cc3 tempest-ProjectReaderTests-1256726025 None] Created volume successfully. Nov 06 21:31:23 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 Nov 06 21:31:23 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:24 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10" returned: 0 in 0.567s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:24 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10 Nov 06 21:31:24 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Flow 'volume_create_manager' (b2c4d632-306c-4ab3-9392-e6c10914fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c8f3ff-7113-4a9d-b32d-2914d9f572fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c8f3ff-7113-4a9d-b32d-2914d9f572fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1392748329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff48ec04-fd33-45e1-825e-ef988f36e80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2834c1bc90d42119875c55bbf6a975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:24Z,use_quota=True,user_id='e83336745fbb433dafc0eea188e94c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872242a5-6f0c-4958-96f6-49dbfb50efc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872242a5-6f0c-4958-96f6-49dbfb50efc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080f309b-d6bb-466b-8162-278b5f79776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080f309b-d6bb-466b-8162-278b5f79776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff48ec04-fd33-45e1-825e-ef988f36e80f', 'volume_name': 'volume-ff48ec04-fd33-45e1-825e-ef988f36e80f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a359a7-35f6-47cc-a612-eb08e185784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a359a7-35f6-47cc-a612-eb08e185784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3236cb3f-1105-49c4-aab6-caf16494ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:24 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Volume ff48ec04-fd33-45e1-825e-ef988f36e80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff48ec04-fd33-45e1-825e-ef988f36e80f', 'volume_size': 1} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1392748329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff48ec04-fd33-45e1-825e-ef988f36e80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2834c1bc90d42119875c55bbf6a975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:24Z,use_quota=True,user_id='e83336745fbb433dafc0eea188e94c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Creating volume ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:24 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:24 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f 1073741824 Nov 06 21:31:24 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:24 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-9d02349b-2f66-4e87-863f-e99d83871b10" returned: 0 in 0.305s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-9d02349b-2f66-4e87-863f-e99d83871b10" released by "delete_volume" :: held 0.978s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Created reservations ['9ce3e2ab-e95e-4626-95d1-bcc066756a1e', '2966859c-04f1-409f-9b02-c7747561ed1e', '13027bd0-0dd1-433d-a4c5-c60e6f24b671', 'a1649a72-4a2d-4b84-a331-a16fc8d111d9'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:24 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:24 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-f190f40e-02b9-40f8-9bd5-bed9dea4297a-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-f190f40e-02b9-40f8-9bd5-bed9dea4297a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-quobyte-f190f40e-02b9-40f8-9bd5-bed9dea4297a" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-f190f40e-02b9-40f8-9bd5-bed9dea4297a" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[76755364-96f1-4b9a-8d4e-05302f6e5ce0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:24 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f 1073741824" returned: 0 in 0.658s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:24 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.403s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Deleted volume successfully. Nov 06 21:31:25 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f Nov 06 21:31:25 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-414d44d5-ab48-4fd4-99b3-a69c724ae6f4 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-9d02349b-2f66-4e87-863f-e99d83871b10-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:25 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a Nov 06 21:31:25 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3236cb3f-1105-49c4-aab6-caf16494ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff48ec04-fd33-45e1-825e-ef988f36e80f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6756a375-43fa-49e5-8969-aa146360b26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:25 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Volume volume-ff48ec04-fd33-45e1-825e-ef988f36e80f (ff48ec04-fd33-45e1-825e-ef988f36e80f): created successfully Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6756a375-43fa-49e5-8969-aa146360b26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Flow 'volume_create_manager' (b2c4d632-306c-4ab3-9392-e6c10914fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d6c90c7e-5a1d-4fd8-b281-94e113abd223 tempest-VolumeDependencyTests-1560190905 None] Created volume successfully. Nov 06 21:31:25 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a" returned: 0 in 0.433s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a Nov 06 21:31:25 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-930e0d44-d3c7-440a-91d1-7439b68b7187-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-930e0d44-d3c7-440a-91d1-7439b68b7187-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "cinder-quobyte-930e0d44-d3c7-440a-91d1-7439b68b7187" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:25 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f190f40e-02b9-40f8-9bd5-bed9dea4297a" returned: 0 in 0.335s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-930e0d44-d3c7-440a-91d1-7439b68b7187" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-f190f40e-02b9-40f8-9bd5-bed9dea4297a" released by "delete_volume" :: held 0.838s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46a86a3-9a31-4579-965e-625fd14e2290]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Created reservations ['27766f42-62db-4d68-a820-ac1f09bbe9b4', 'b338c8e2-ba36-4821-a458-d865b0f872c0', '3e55bd7f-a774-4177-b8ca-a114c172920f', '70acf433-4526-4e34-9bc2-7599e3163298'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:25 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 Nov 06 21:31:25 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:25 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:25 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:26 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187" returned: 0 in 0.617s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.494s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:26 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Deleted volume successfully. Nov 06 21:31:26 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187 Nov 06 21:31:26 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-82d2a1fb-c92c-4840-8e0d-b6fd5a69378c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-f190f40e-02b9-40f8-9bd5-bed9dea4297a-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (8d13c075-c73a-45fe-b7e8-073d0186fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:26 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341653f6-b885-4741-8577-fe4bdae1ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-930e0d44-d3c7-440a-91d1-7439b68b7187" returned: 0 in 0.418s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341653f6-b885-4741-8577-fe4bdae1ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396962070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb397eb7-2254-4246-b934-422329ac79e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:27Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85326c9e-3b15-4a59-b059-53620362c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85326c9e-3b15-4a59-b059-53620362c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08ec6f0-feaf-4271-b994-fec9cd9eeccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08ec6f0-feaf-4271-b994-fec9cd9eeccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb397eb7-2254-4246-b934-422329ac79e6', 'volume_name': 'volume-eb397eb7-2254-4246-b934-422329ac79e6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddd152c-0c3a-40bb-9717-105ffef6ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddd152c-0c3a-40bb-9717-105ffef6ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c5ab2b-8b35-4e77-bf02-43d0ac172611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Volume eb397eb7-2254-4246-b934-422329ac79e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb397eb7-2254-4246-b934-422329ac79e6', 'volume_size': 1} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396962070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb397eb7-2254-4246-b934-422329ac79e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:27Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Creating volume eb397eb7-2254-4246-b934-422329ac79e6 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-quobyte-930e0d44-d3c7-440a-91d1-7439b68b7187" released by "delete_volume" :: held 1.162s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:26 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 1073741824 Nov 06 21:31:26 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Created reservations ['83048095-f7f5-451c-b29f-ca6446e47b59', '9025b4f2-0cf6-41df-8f8c-c18398b06b0d', 'e0366d6f-b8b9-42ed-962e-eab955b78995', 'c6938704-50a3-49c7-936e-c8a125a291f1'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:27 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:27 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:27 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Deleted volume successfully. Nov 06 21:31:27 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 1073741824" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-99be9577-6c87-4e3c-863a-22d7b1e62439 tempest-SnapshotDependencyTests-1389651013 None] Lock "cinder-930e0d44-d3c7-440a-91d1-7439b68b7187-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:27 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 Nov 06 21:31:27 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:27 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.774s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Creating offline snapshot 2f074489-a66b-4020-a70b-f90fd68d8c03 of volume ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c5ab2b-8b35-4e77-bf02-43d0ac172611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb397eb7-2254-4246-b934-422329ac79e6', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afe9a36-83ca-4e8b-908f-1814f0de167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce2d28-26b5-498f-82e6-5b8d51f9c02b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Volume volume-eb397eb7-2254-4246-b934-422329ac79e6 (eb397eb7-2254-4246-b934-422329ac79e6): created successfully Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afe9a36-83ca-4e8b-908f-1814f0de167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (8d13c075-c73a-45fe-b7e8-073d0186fb42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3f62c1dd-dddd-4ec2-8040-9625907bdb5c tempest-ProjectReaderTests-1256726025 None] Created volume successfully. Nov 06 21:31:27 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f Nov 06 21:31:27 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:28 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:28 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 1G Nov 06 21:31:28 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:28 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 1G" returned: 0 in 0.490s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff48ec04-fd33-45e1-825e-ef988f36e80f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:28 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff48ec04-fd33-45e1-825e-ef988f36e80f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 Nov 06 21:31:28 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-eb397eb7-2254-4246-b934-422329ac79e6-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-eb397eb7-2254-4246-b934-422329ac79e6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-quobyte-eb397eb7-2254-4246-b934-422329ac79e6" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-eb397eb7-2254-4246-b934-422329ac79e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4852a7d2-36c8-4773-9ca7-18a8b4787d1d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff48ec04-fd33-45e1-825e-ef988f36e80f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03" returned: 0 in 0.499s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 is being set with open permissions: ugo+rw Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 Nov 06 21:31:29 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 Nov 06 21:31:29 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03" returned: 0 in 0.288s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6" returned: 0 in 0.410s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6 Nov 06 21:31:29 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info Nov 06 21:31:29 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb397eb7-2254-4246-b934-422329ac79e6" returned: 0 in 0.373s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-eb397eb7-2254-4246-b934-422329ac79e6" released by "delete_volume" :: held 0.841s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info" returned: 0 in 0.377s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:29 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info is being set with open permissions: ugo+rw Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:29 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info Nov 06 21:31:29 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:29 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Created reservations ['8e8c5fd5-6ba4-4b33-96e3-49ddd365bac8', '9d2cda46-401e-4551-a8be-bd1d9565842d', '5cf4c68d-36a1-4541-9c5f-3568f582d798', '942cab62-fe9c-4305-b09b-1e0d1af8465e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:30 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:30 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:30 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.info" returned: 0 in 0.439s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c0c88e89-42e6-4e9c-8d82-cf488c0ef55c tempest-VolumeDependencyTests-1560190905 None] Create snapshot completed successfully Nov 06 21:31:30 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.474s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Deleted volume successfully. Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-fc4b644f-fd75-4482-b3d5-fafbeaf82da1 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-eb397eb7-2254-4246-b934-422329ac79e6-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (3332af97-6e77-4647-8b91-d66f4d1f7139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e24c62e-f25b-443d-9681-e6d3b31b25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e24c62e-f25b-443d-9681-e6d3b31b25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963530780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e053dcea-2496-4b54-9a28-cb8194ba2bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:31Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34941268-5922-4ad2-adf8-89e6ea827007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34941268-5922-4ad2-adf8-89e6ea827007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6100c0f3-0b2c-4162-a5d6-c3b8a0749bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6100c0f3-0b2c-4162-a5d6-c3b8a0749bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e053dcea-2496-4b54-9a28-cb8194ba2bf0', 'volume_name': 'volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73553ae0-169a-4718-90c9-158fd832e730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73553ae0-169a-4718-90c9-158fd832e730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6cf4cb-ec9c-4eae-89a1-741a9a829ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Volume e053dcea-2496-4b54-9a28-cb8194ba2bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0', 'volume_size': 1} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963530780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e053dcea-2496-4b54-9a28-cb8194ba2bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:31Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Creating volume e053dcea-2496-4b54-9a28-cb8194ba2bf0 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:31 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:31 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 1073741824 Nov 06 21:31:31 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Flow 'volume_create_manager' (710fa2da-f412-4923-8b0e-3449ef6c4807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35e6401-7f92-4eb8-8a8c-58955b6507f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35e6401-7f92-4eb8-8a8c-58955b6507f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1960817035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2834c1bc90d42119875c55bbf6a975d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f074489-a66b-4020-a70b-f90fd68d8c03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:32Z,use_quota=True,user_id='e83336745fbb433dafc0eea188e94c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7080fa-ceeb-41c1-ac59-0a52ea0e2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7080fa-ceeb-41c1-ac59-0a52ea0e2949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9ac512-80ba-4c7c-a3bf-c70e8f491990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9ac512-80ba-4c7c-a3bf-c70e8f491990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed', 'volume_name': 'volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed', 'volume_size': 1, 'snapshot_id': '2f074489-a66b-4020-a70b-f90fd68d8c03'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8482e9-7431-417e-9070-5bf6629f3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8482e9-7431-417e-9070-5bf6629f3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b8d2a-2eb0-47d1-91ab-4520ab4c575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Volume 3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed', 'volume_size': 1, 'snapshot_id': '2f074489-a66b-4020-a70b-f90fd68d8c03'} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 1073741824" returned: 0 in 0.783s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:31 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 Nov 06 21:31:31 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:32 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:32 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:32 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0" returned: 0 in 0.293s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.322s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-quobyte-2f074489-a66b-4020-a70b-f90fd68d8c03-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6cf4cb-ec9c-4eae-89a1-741a9a829ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6063db-3769-42f6-9689-e19fc78640be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-2f074489-a66b-4020-a70b-f90fd68d8c03-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Creating volume 3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed from snapshot 2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-quobyte-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:32 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Volume volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 (e053dcea-2496-4b54-9a28-cb8194ba2bf0): created successfully Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6063db-3769-42f6-9689-e19fc78640be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (3332af97-6e77-4647-8b91-d66f4d1f7139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] snapshot: 2f074489-a66b-4020-a70b-f90fd68d8c03, volume: 3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:31:32 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b02b6bf5-dae3-4577-a722-f4a5c961f8d8 tempest-ProjectReaderTests-1256726025 None] Created volume successfully. Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4450ff9-3529-4ebf-adc7-e7433bb49316]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:32 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.303s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:31:32 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 Nov 06 21:31:32 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:32 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03" returned: 0 in 0.513s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff48ec04-fd33-45e1-825e-ef988f36e80f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116263e-e843-4a66-93d5-80899be39b83]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:33 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f Nov 06 21:31:33 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-e053dcea-2496-4b54-9a28-cb8194ba2bf0-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-e053dcea-2496-4b54-9a28-cb8194ba2bf0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-quobyte-e053dcea-2496-4b54-9a28-cb8194ba2bf0" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-e053dcea-2496-4b54-9a28-cb8194ba2bf0" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec21191e-ed32-4ec2-8fd2-615ff5776f91]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:33 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 Nov 06 21:31:33 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:33 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f" returned: 0 in 0.575s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:33 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed Nov 06 21:31:33 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:33 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0" returned: 0 in 0.491s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:33 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0 Nov 06 21:31:33 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:34 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-e053dcea-2496-4b54-9a28-cb8194ba2bf0" returned: 0 in 0.374s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-e053dcea-2496-4b54-9a28-cb8194ba2bf0" released by "delete_volume" :: held 0.944s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Created reservations ['e8cd2e19-a677-4bb5-b896-a3db844580db', 'ca7c256f-3643-480e-854a-0ae3ed9834a2', '8e950c4f-dda5-4b59-81e5-2e02278d0da7', 'f88e93f1-c782-449b-93e8-d05536e42e83'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:34 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:34 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:35 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.824s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:35 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Deleted volume successfully. Nov 06 21:31:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-781b443b-c45b-4a08-9958-cb35d2cc77d6 tempest-ProjectReaderTests-1256726025 None] Lock "cinder-e053dcea-2496-4b54-9a28-cb8194ba2bf0-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (daece728-3b2f-432c-ad9e-1e51d5eadcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234122d0-25b5-447f-8fba-580d3ff26473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234122d0-25b5-447f-8fba-580d3ff26473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108465734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648a90ac-1c30-494f-a500-3630f4e76bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:37Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f735795-0720-47e7-b28c-a4c3fae007fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f735795-0720-47e7-b28c-a4c3fae007fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf6050d-a9f8-4938-a9fb-5f2bbf1b65f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf6050d-a9f8-4938-a9fb-5f2bbf1b65f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648a90ac-1c30-494f-a500-3630f4e76bac', 'volume_name': 'volume-648a90ac-1c30-494f-a500-3630f4e76bac', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b212b795-3e43-4b45-b66f-f8688e5ddcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b212b795-3e43-4b45-b66f-f8688e5ddcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768fae62-4697-4ffe-bd2e-471487cf1536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Volume 648a90ac-1c30-494f-a500-3630f4e76bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648a90ac-1c30-494f-a500-3630f4e76bac', 'volume_size': 1} Nov 06 21:31:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:41 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" returned: 0 in 8.475s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:41 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:31:41 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Converted 1024.00 MB image at 120.81 MB/s Nov 06 21:31:41 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed is being set with open permissions: ugo+rw Nov 06 21:31:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:41 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed Nov 06 21:31:41 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:42 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" returned: 0 in 0.274s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" released by "_copy_volume_from_snapshot" :: held 9.954s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-2f074489-a66b-4020-a70b-f90fd68d8c03-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" released by "_create_volume_from_snapshot" :: held 10.060s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.106s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.302s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108465734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648a90ac-1c30-494f-a500-3630f4e76bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a540a9bea7a54722822475ce80c1e65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:37Z,use_quota=True,user_id='3cf212efb64a49a08467c0ed09757ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Creating volume 648a90ac-1c30-494f-a500-3630f4e76bac {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:42 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:42 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac 1073741824 Nov 06 21:31:42 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102b8d2a-2eb0-47d1-91ab-4520ab4c575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed', 'volume_size': 1, 'snapshot_id': '2f074489-a66b-4020-a70b-f90fd68d8c03'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1914dcf9-e445-4527-99d2-12b6c582feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Volume volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed (3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed): created successfully Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1914dcf9-e445-4527-99d2-12b6c582feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Flow 'volume_create_manager' (710fa2da-f412-4923-8b0e-3449ef6c4807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1e0d6b7e-9879-4e21-bc87-91f7f3c9bb2a tempest-VolumeDependencyTests-1560190905 None] Created volume successfully. Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-2f074489-a66b-4020-a70b-f90fd68d8c03-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:42 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac 1073741824" returned: 0 in 0.621s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-2f074489-a66b-4020-a70b-f90fd68d8c03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-quobyte-ff48ec04-fd33-45e1-825e-ef988f36e80f" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-ff48ec04-fd33-45e1-825e-ef988f36e80f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-quobyte-2f074489-a66b-4020-a70b-f90fd68d8c03" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-2f074489-a66b-4020-a70b-f90fd68d8c03" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Deleting offline snapshot 2f074489-a66b-4020-a70b-f90fd68d8c03 of volume ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:31:43 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac Nov 06 21:31:43 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] snapshot_file for this snap is: volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[db708253-d148-46e1-8cec-690b31607141]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:43 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 Nov 06 21:31:43 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:43 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac" returned: 0 in 0.416s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768fae62-4697-4ffe-bd2e-471487cf1536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648a90ac-1c30-494f-a500-3630f4e76bac', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f99572-b6a0-42a5-96c4-43954442d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Volume volume-648a90ac-1c30-494f-a500-3630f4e76bac (648a90ac-1c30-494f-a500-3630f4e76bac): created successfully Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f99572-b6a0-42a5-96c4-43954442d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Flow 'volume_create_manager' (daece728-3b2f-432c-ad9e-1e51d5eadcdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4ed05a9c-9711-424d-9f9b-52c99ef27dd7 tempest-ProjectReaderTests-1256726025 None] Created volume successfully. Nov 06 21:31:43 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03" returned: 0 in 0.482s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff48ec04-fd33-45e1-825e-ef988f36e80f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9640dcbf-e7eb-4332-8046-2fc39c284260]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:43 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f Nov 06 21:31:43 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:44 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f" returned: 0 in 0.595s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:44 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 Nov 06 21:31:44 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-648a90ac-1c30-494f-a500-3630f4e76bac-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-648a90ac-1c30-494f-a500-3630f4e76bac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "cinder-quobyte-648a90ac-1c30-494f-a500-3630f4e76bac" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-648a90ac-1c30-494f-a500-3630f4e76bac" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b717c7-0ad2-49b0-8e12-aa61c6e11144]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:44 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03" returned: 0 in 0.445s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:44 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03 Nov 06 21:31:44 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:44 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac Nov 06 21:31:44 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:44 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f.2f074489-a66b-4020-a70b-f90fd68d8c03" returned: 0 in 0.331s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-2f074489-a66b-4020-a70b-f90fd68d8c03" released by "_delete_snapshot" :: held 2.058s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-ff48ec04-fd33-45e1-825e-ef988f36e80f" released by "delete_snapshot" :: held 2.114s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:45 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac" returned: 0 in 0.524s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Created reservations ['35089320-4d52-4e20-a8f6-d38e996b809d', '10ce6410-7d9d-4a04-992f-7011574f26e9', '5402e20a-d8d6-4276-abb9-53a8e465a586', 'f224a91e-bb23-478b-ae00-c303c88eb587'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:45 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac Nov 06 21:31:45 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Delete snapshot completed successfully. Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d9ce999e-f45a-478c-b124-5702e2105a9c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-2f074489-a66b-4020-a70b-f90fd68d8c03-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:45 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-648a90ac-1c30-494f-a500-3630f4e76bac" returned: 0 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-quobyte-648a90ac-1c30-494f-a500-3630f4e76bac" released by "delete_volume" :: held 0.895s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Created reservations ['bc34a8f6-9232-441d-abfe-745cb4dc55b6', '4655596e-ddf6-4856-989e-d0161175ead6', 'd2e33fc0-d601-4b31-9d83-9d2b49e6049e', 'e8196093-1608-4eb8-8008-cbd64279a458'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:45 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:45 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:45 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.286s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Deleted volume successfully. Nov 06 21:31:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-af634afb-4948-48fa-bf91-5a592c35812c tempest-ProjectReaderTests-1256726025 None] Lock "cinder-648a90ac-1c30-494f-a500-3630f4e76bac-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-ff48ec04-fd33-45e1-825e-ef988f36e80f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-ff48ec04-fd33-45e1-825e-ef988f36e80f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-quobyte-ff48ec04-fd33-45e1-825e-ef988f36e80f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-ff48ec04-fd33-45e1-825e-ef988f36e80f" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42248dd-5d46-4dc4-b47f-4e41388a626f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:46 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f Nov 06 21:31:46 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:46 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f" returned: 0 in 0.473s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:46 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f Nov 06 21:31:46 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:47 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ff48ec04-fd33-45e1-825e-ef988f36e80f" returned: 0 in 0.286s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-ff48ec04-fd33-45e1-825e-ef988f36e80f" released by "delete_volume" :: held 0.846s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Created reservations ['474b258e-0211-40c7-977d-22b43906a4cc', '39828c7e-2b5c-48ff-a09c-d1bd11823326', 'fa10180c-6c3e-4bc9-915b-217f463381a5', '3f0d58ff-01d6-428e-b55f-9dfad9094e58'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:47 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:47 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "cinder-quobyte-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6704de-e950-41c6-b819-717a616cb2a6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:47 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.397s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Deleted volume successfully. Nov 06 21:31:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a5524de4-c6cd-4ce0-8ecf-cfa95f098724 tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-ff48ec04-fd33-45e1-825e-ef988f36e80f-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:47 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed Nov 06 21:31:47 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" returned: 0 in 0.517s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:48 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed Nov 06 21:31:48 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Flow 'volume_create_manager' (36008243-96b5-4ccf-9c9e-442dc4b48ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40197512-df86-4013-a4a5-2fe1fc9f4c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40197512-df86-4013-a4a5-2fe1fc9f4c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-788151536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b454899e-ebf0-4745-8a21-4a6360e25260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961586485d094907bb04752bf98053b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:48Z,use_quota=True,user_id='e1123f5a86de492bb9cee35e833c6ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8287d627-7626-4f60-a3c3-2900ca7d6bd5),volume_type_id=8287d627-7626-4f60-a3c3-2900ca7d6bd5)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85daebb4-ffa2-431f-89c9-0181dc4299ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85daebb4-ffa2-431f-89c9-0181dc4299ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410ccf1c-63db-4142-a69f-49d373f7a8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410ccf1c-63db-4142-a69f-49d373f7a8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b454899e-ebf0-4745-8a21-4a6360e25260', 'volume_name': 'volume-b454899e-ebf0-4745-8a21-4a6360e25260', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b07c44-a622-4f37-bd48-96277e6a08dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b07c44-a622-4f37-bd48-96277e6a08dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9857fb-de4b-4b91-938d-b2af88246415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume b454899e-ebf0-4745-8a21-4a6360e25260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b454899e-ebf0-4745-8a21-4a6360e25260', 'volume_size': 1} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-788151536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b454899e-ebf0-4745-8a21-4a6360e25260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961586485d094907bb04752bf98053b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:48Z,use_quota=True,user_id='e1123f5a86de492bb9cee35e833c6ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8287d627-7626-4f60-a3c3-2900ca7d6bd5),volume_type_id=8287d627-7626-4f60-a3c3-2900ca7d6bd5)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Creating volume b454899e-ebf0-4745-8a21-4a6360e25260 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:48 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:48 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 1073741824 Nov 06 21:31:48 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-quobyte-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed" released by "delete_volume" :: held 0.891s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Created reservations ['d667c7e7-c332-4be8-ace1-12611a94c3a9', '9448b161-0ac8-4acd-9aab-97a1452237e4', 'de5dec7d-8334-439d-8698-787cb4b8d373', '90240982-c4d8-412b-93c8-fa4f50cf7d62'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:48 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:31:48 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Flow 'volume_create_manager' (324011f3-4573-47a9-8e8f-83968eb3179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f29137-1f87-49e7-9b3c-ef027960c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f29137-1f87-49e7-9b3c-ef027960c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-438623617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961586485d094907bb04752bf98053b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:49Z,use_quota=True,user_id='e1123f5a86de492bb9cee35e833c6ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e7685da-e941-4272-858f-b0cd157f56e6),volume_type_id=8e7685da-e941-4272-858f-b0cd157f56e6)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010dbfa4-5048-486a-b7b5-12d85f74765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010dbfa4-5048-486a-b7b5-12d85f74765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3f89d1-0996-4fd8-a0c1-2391e76a740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3f89d1-0996-4fd8-a0c1-2391e76a740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde', 'volume_name': 'volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:48 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc43e32-d19b-4924-a466-220d6427cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc43e32-d19b-4924-a466-220d6427cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b850eef6-4374-43a1-9dd5-2a66df1e8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde', 'volume_size': 1} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 1073741824" returned: 0 in 0.632s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:49 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 Nov 06 21:31:49 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:49 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.373s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:31:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Deleted volume successfully. Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-521d2c5e-c278-42a8-87c9-e3e44015ca8c tempest-VolumeDependencyTests-1560190905 None] Lock "cinder-3c3dd5d1-6efb-4e52-b4a0-7cd48a0883ed-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:31:49 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260" returned: 0 in 0.286s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-438623617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961586485d094907bb04752bf98053b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:49Z,use_quota=True,user_id='e1123f5a86de492bb9cee35e833c6ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e7685da-e941-4272-858f-b0cd157f56e6),volume_type_id=8e7685da-e941-4272-858f-b0cd157f56e6)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Creating volume c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:49 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9857fb-de4b-4b91-938d-b2af88246415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b454899e-ebf0-4745-8a21-4a6360e25260', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde 1073741824 Nov 06 21:31:49 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b5fe8a-f673-462d-9e1d-987594bcee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume volume-b454899e-ebf0-4745-8a21-4a6360e25260 (b454899e-ebf0-4745-8a21-4a6360e25260): created successfully Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b5fe8a-f673-462d-9e1d-987594bcee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Flow 'volume_create_manager' (36008243-96b5-4ccf-9c9e-442dc4b48ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c6b8a86f-11db-4ff8-98d0-c86f398017f1 tempest-TestInstancesWithCinderVolumes-1826921031 None] Created volume successfully. Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Flow 'volume_create_manager' (f3e230de-7fc8-4c83-93e4-737814ec5106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e418858b-059a-4363-b435-58fc34ec628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e418858b-059a-4363-b435-58fc34ec628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132483881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0236c-dc13-45c8-a0dd-267e8358e7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961586485d094907bb04752bf98053b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:50Z,use_quota=True,user_id='e1123f5a86de492bb9cee35e833c6ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b92a38d8-ed84-4d61-8d8d-9c064b6f8412),volume_type_id=b92a38d8-ed84-4d61-8d8d-9c064b6f8412)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c49bda-20a7-4a4f-8aa9-a01faef3039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c49bda-20a7-4a4f-8aa9-a01faef3039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7087ae-7ea8-44a8-a2a6-7be4d2315122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:31:49 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde 1073741824" returned: 0 in 0.494s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:49 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde Nov 06 21:31:49 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7087ae-7ea8-44a8-a2a6-7be4d2315122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fb0236c-dc13-45c8-a0dd-267e8358e7f8', 'volume_name': 'volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8', 'volume_size': 1, 'image_id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1935691290', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '961586485d094907bb04752bf98053b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'created_at': datetime.datetime(2026, 11, 6, 20, 31, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 31, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110/file', 'properties': {}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c79e707-089d-4fc8-b2bf-90f596abcf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c79e707-089d-4fc8-b2bf-90f596abcf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2704d4a9-1210-417c-9ba5-3f8f53bc8018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume 3fb0236c-dc13-45c8-a0dd-267e8358e7f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8', 'volume_size': 1, 'image_id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1935691290', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '961586485d094907bb04752bf98053b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'created_at': datetime.datetime(2026, 11, 6, 20, 31, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 31, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110/file', 'properties': {}}, 'image_service': } Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Trying to clone 3fb0236c-dc13-45c8-a0dd-267e8358e7f8 from image a7598983-f2f9-4eb1-81b6-dc26b06f6110 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:31:50 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b850eef6-4374-43a1-9dd5-2a66df1e8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8441054-a2f9-45bf-a827-ead6a9196807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde (c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde): created successfully Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8441054-a2f9-45bf-a827-ead6a9196807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Flow 'volume_create_manager' (324011f3-4573-47a9-8e8f-83968eb3179d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-fd25b830-c63b-4ad6-a88d-266b8ff2f2f9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Created volume successfully. Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD, size 20.69 MB, duration 3.30 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:31:53 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Image download 20.69 MB at 6.26 MB/s Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d90c39-0588-4b30-920b-783f166b211e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:53 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD Nov 06 21:31:53 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:53 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Temporary image a7598983-f2f9-4eb1-81b6-dc26b06f6110 is fetched for user e1123f5a86de492bb9cee35e833c6ac7. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=102,cinder:UPDATE=152,cinder:DELETE=15,cinder:INSERT=35 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=145,cinder:INSERT=36,cinder:SELECT=111,cinder:DELETE=12 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1367ec-e175-4caa-8db9-ad6ce0916051]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:54 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD Nov 06 21:31:54 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:54 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132483881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0236c-dc13-45c8-a0dd-267e8358e7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961586485d094907bb04752bf98053b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:31:50Z,use_quota=True,user_id='e1123f5a86de492bb9cee35e833c6ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b92a38d8-ed84-4d61-8d8d-9c064b6f8412),volume_type_id=b92a38d8-ed84-4d61-8d8d-9c064b6f8412)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Creating volume 3fb0236c-dc13-45c8-a0dd-267e8358e7f8 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:31:54 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:54 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 1073741824 Nov 06 21:31:54 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:54 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 1073741824" returned: 0 in 0.499s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:54 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 Nov 06 21:31:54 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" returned: 0 in 0.286s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Attempting download of a7598983-f2f9-4eb1-81b6-dc26b06f6110 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'metadata': {}}])) to volume 3fb0236c-dc13-45c8-a0dd-267e8358e7f8. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ace616-d6fa-460e-8af9-138d2ed6ea30]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:55 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl Nov 06 21:31:55 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:55 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl Nov 06 21:31:55 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:55 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl" returned: 1 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7598983-f2f9-4eb1-81b6-dc26b06f6110_ldxutakl' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c20d3-86f5-4109-a775-41cc90a68182]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:31:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:56 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD Nov 06 21:31:56 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:56 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:56 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] a7598983-f2f9-4eb1-81b6-dc26b06f6110 was qcow2, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:31:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:56 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 Nov 06 21:31:56 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:57 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" returned: 0 in 1.745s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:57 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7598983-f2f9-4eb1-81b6-dc26b06f6110_s5mtu9tndevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:31:57 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Converted 112.00 MB image at 64.14 MB/s Nov 06 21:31:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:31:57 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 1G Nov 06 21:31:57 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:31:58 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 1G" returned: 0 in 0.330s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Downloaded image a7598983-f2f9-4eb1-81b6-dc26b06f6110 ((None, [{'url': 'file:///opt/stack/data/glance/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'metadata': {}}])) to volume 3fb0236c-dc13-45c8-a0dd-267e8358e7f8 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Temporary image a7598983-f2f9-4eb1-81b6-dc26b06f6110 for user e1123f5a86de492bb9cee35e833c6ac7 is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Marking volume 3fb0236c-dc13-45c8-a0dd-267e8358e7f8 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Copying metadata from image a7598983-f2f9-4eb1-81b6-dc26b06f6110 to 3fb0236c-dc13-45c8-a0dd-267e8358e7f8. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Creating volume glance metadata for volume 3fb0236c-dc13-45c8-a0dd-267e8358e7f8 backed by image a7598983-f2f9-4eb1-81b6-dc26b06f6110 with: {'image_id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'image_name': 'tempest-scenario-img--1935691290', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2704d4a9-1210-417c-9ba5-3f8f53bc8018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8', 'volume_size': 1, 'image_id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1935691290', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '961586485d094907bb04752bf98053b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7598983-f2f9-4eb1-81b6-dc26b06f6110', 'created_at': datetime.datetime(2026, 11, 6, 20, 31, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 31, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7598983-f2f9-4eb1-81b6-dc26b06f6110/file', 'properties': {}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d4636-c38d-4e5c-b2ec-583a3d4009a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:31:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Volume volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 (3fb0236c-dc13-45c8-a0dd-267e8358e7f8): created successfully Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d4636-c38d-4e5c-b2ec-583a3d4009a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:31:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Flow 'volume_create_manager' (f3e230de-7fc8-4c83-93e4-737814ec5106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:31:58 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8f811195-e481-4fa9-a6e0-2e73f574b09e tempest-TestInstancesWithCinderVolumes-1826921031 None] Created volume successfully. Nov 06 21:32:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-37d513da-5d58-42ff-8cab-dd88ba876351 req-a1941c64-14a2-4ce2-87b2-6d1ffd57dda5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-37d513da-5d58-42ff-8cab-dd88ba876351 req-a1941c64-14a2-4ce2-87b2-6d1ffd57dda5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-37d513da-5d58-42ff-8cab-dd88ba876351 req-a1941c64-14a2-4ce2-87b2-6d1ffd57dda5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-37d513da-5d58-42ff-8cab-dd88ba876351 req-a1941c64-14a2-4ce2-87b2-6d1ffd57dda5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36af882e-b7b5-4406-a3ab-174db7198281', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:32:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-37d513da-5d58-42ff-8cab-dd88ba876351 req-a1941c64-14a2-4ce2-87b2-6d1ffd57dda5 tempest-TestInstancesWithCinderVolumes-1826921031 None] attachment_update completed successfully. Nov 06 21:32:12 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:12 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:INSERT=6,cinder:UPDATE=4,cinder:SELECT=11,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:32:32 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:32 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.260s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:32:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:32:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d2b71f0d-94c0-45ff-97a8-cbc353b18af1 req-871edfd9-573c-4a2b-b071-cf16933659c5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d2b71f0d-94c0-45ff-97a8-cbc353b18af1 req-871edfd9-573c-4a2b-b071-cf16933659c5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-d2b71f0d-94c0-45ff-97a8-cbc353b18af1 req-871edfd9-573c-4a2b-b071-cf16933659c5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-d2b71f0d-94c0-45ff-97a8-cbc353b18af1 req-871edfd9-573c-4a2b-b071-cf16933659c5 tempest-TestInstancesWithCinderVolumes-1826921031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-b454899e-ebf0-4745-8a21-4a6360e25260', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65098b78-bbdf-45d1-b2a1-a792b7a4743d', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:32:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-d2b71f0d-94c0-45ff-97a8-cbc353b18af1 req-871edfd9-573c-4a2b-b071-cf16933659c5 tempest-TestInstancesWithCinderVolumes-1826921031 None] attachment_update completed successfully. Nov 06 21:32:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-6f0bfc7b-1ea8-4fbe-9527-3ebd3569b16b req-47636194-5739-43cc-a0f8-5e3fbd1e9b32 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-6f0bfc7b-1ea8-4fbe-9527-3ebd3569b16b req-47636194-5739-43cc-a0f8-5e3fbd1e9b32 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-6f0bfc7b-1ea8-4fbe-9527-3ebd3569b16b req-47636194-5739-43cc-a0f8-5e3fbd1e9b32 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-6f0bfc7b-1ea8-4fbe-9527-3ebd3569b16b req-47636194-5739-43cc-a0f8-5e3fbd1e9b32 tempest-TestInstancesWithCinderVolumes-1826921031 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdee1393-6ca6-4579-b647-93150d835afe', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:32:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-6f0bfc7b-1ea8-4fbe-9527-3ebd3569b16b req-47636194-5739-43cc-a0f8-5e3fbd1e9b32 tempest-TestInstancesWithCinderVolumes-1826921031 None] attachment_update completed successfully. Nov 06 21:32:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-8c63e56c-2dbb-42e2-87de-89363f86d4b0 req-a8c2f40a-5ab5-4341-9e37-0aa93bee74a2 tempest-TestInstancesWithCinderVolumes-1826921031 None] Terminate volume connection completed successfully. Nov 06 21:32:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-8c63e56c-2dbb-42e2-87de-89363f86d4b0 req-a8c2f40a-5ab5-4341-9e37-0aa93bee74a2 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deleting attachment 65098b78-bbdf-45d1-b2a1-a792b7a4743d. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:32:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "cinder-b454899e-ebf0-4745-8a21-4a6360e25260-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-b454899e-ebf0-4745-8a21-4a6360e25260-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "cinder-quobyte-b454899e-ebf0-4745-8a21-4a6360e25260" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-quobyte-b454899e-ebf0-4745-8a21-4a6360e25260" acquired by "delete_volume" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:41 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45bcb4-66cb-471a-98c5-d7e5c06924a8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:32:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:41 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 Nov 06 21:32:41 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:42 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260" returned: 0 in 0.387s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:42 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260 Nov 06 21:32:42 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:42 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b454899e-ebf0-4745-8a21-4a6360e25260" returned: 0 in 0.263s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-quobyte-b454899e-ebf0-4745-8a21-4a6360e25260" released by "delete_volume" :: held 0.690s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:42 devstack cinder-volume[87350]: WARNING cinder.quota [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1445453716-183189548 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1445453716-183189548, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:32:42 devstack cinder-volume[87350]: WARNING cinder.quota [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1445453716-183189548 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1445453716-183189548, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Created reservations ['bd8f3ee9-89b1-43a8-8443-a2256a509f7e', 'ad9f8ef6-0327-4ebb-81fc-c8a253a04da1', '89206710-e8ea-4fcc-accf-7944dc7d90ab', '02394527-d31d-4702-b6f7-33eef661320e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:42 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:32:42 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:42 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.242s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deleted volume successfully. Nov 06 21:32:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f0413998-8b6f-40ab-bc27-82bce37c3dc0 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-b454899e-ebf0-4745-8a21-4a6360e25260-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-0bb6fe05-756a-427d-b8cd-3377a4feae45 req-6a9f48ae-39eb-43e3-b98c-a01e2034a83b tempest-TestInstancesWithCinderVolumes-1826921031 None] Terminate volume connection completed successfully. Nov 06 21:32:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-0bb6fe05-756a-427d-b8cd-3377a4feae45 req-6a9f48ae-39eb-43e3-b98c-a01e2034a83b tempest-TestInstancesWithCinderVolumes-1826921031 None] Deleting attachment cdee1393-6ca6-4579-b647-93150d835afe. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "cinder-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "cinder-quobyte-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-quobyte-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a4604-fc2c-43b8-b020-3ef8901442d8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:46 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde Nov 06 21:32:46 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:46 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde" returned: 0 in 0.389s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:46 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde Nov 06 21:32:46 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:46 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde" returned: 0 in 0.249s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-quobyte-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde" released by "delete_volume" :: held 0.685s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:46 devstack cinder-volume[87350]: WARNING cinder.quota [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718533324-1133102021 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718533324-1133102021, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:32:46 devstack cinder-volume[87350]: WARNING cinder.quota [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718533324-1133102021 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718533324-1133102021, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Created reservations ['ccb36e01-6652-4bc1-8ab5-cff16b2a4aa6', '7c3db8e6-e34c-4eb1-960f-8a6c10456b7d', '635b7177-86cb-43c4-b842-251d17b8ee00', '58dcf569-00b9-48bd-af86-6a83d634aa23'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:46 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:32:46 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:47 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.288s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deleted volume successfully. Nov 06 21:32:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e275febe-cd10-4824-9b44-a115f5852799 tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-c8eb0ec8-aa41-4057-aa29-fa2d6ecc3dde-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-6fb85cbd-70a3-47ba-a07a-18a919c3f875 req-05118809-4cbe-499a-b903-7bdb181b7ff9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Terminate volume connection completed successfully. Nov 06 21:32:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-6fb85cbd-70a3-47ba-a07a-18a919c3f875 req-05118809-4cbe-499a-b903-7bdb181b7ff9 tempest-TestInstancesWithCinderVolumes-1826921031 None] Deleting attachment 36af882e-b7b5-4406-a3ab-174db7198281. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:32:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "cinder-3fb0236c-dc13-45c8-a0dd-267e8358e7f8-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-3fb0236c-dc13-45c8-a0dd-267e8358e7f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "cinder-quobyte-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-quobyte-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6243fe1-7ba1-493d-8991-42dd85144035]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:51 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 Nov 06 21:32:51 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:51 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:51 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8 Nov 06 21:32:51 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:51 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" returned: 0 in 0.238s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-quobyte-3fb0236c-dc13-45c8-a0dd-267e8358e7f8" released by "delete_volume" :: held 0.634s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:32:51 devstack cinder-volume[87350]: WARNING cinder.quota [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1415386701-2093681805 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1415386701-2093681805, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:32:51 devstack cinder-volume[87350]: WARNING cinder.quota [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1415386701-2093681805 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1415386701-2093681805, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Created reservations ['b03b5e2c-7f49-47b3-a222-e21eb949daf0', 'd9c11fb0-2310-4cfb-93eb-cf716f774bb0', 'b52cbe8a-10fb-4941-a6b6-0e09778a665c', '8c37783e-90e7-450c-bcb7-c478b120576d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:51 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:32:51 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:51 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.237s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:51 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:51 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Deleted volume successfully. Nov 06 21:32:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-64e9d028-5f67-4e30-a2a1-dd0e30eeb9bc tempest-TestInstancesWithCinderVolumes-1826921031 None] Lock "cinder-3fb0236c-dc13-45c8-a0dd-267e8358e7f8-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:33:01 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:02 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=34,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Flow 'volume_create_manager' (11d74d2a-c73e-49f2-9e09-fdfe07d681f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6d494-5b9a-4c53-a63e-3781d3371d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6d494-5b9a-4c53-a63e-3781d3371d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1280692314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba28ebe-3814-40ff-b1bb-e405f635ea77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2d30485b6b4498a15027da8a0efe0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:23Z,use_quota=True,user_id='013c863101c04656bcfe6be00f31540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3718bb3d-5269-4720-a334-c0bacb273590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3718bb3d-5269-4720-a334-c0bacb273590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5cf742-54e4-49df-8bdd-4fc6014a5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5cf742-54e4-49df-8bdd-4fc6014a5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba28ebe-3814-40ff-b1bb-e405f635ea77', 'volume_name': 'volume-fba28ebe-3814-40ff-b1bb-e405f635ea77', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85591417-f1e7-4621-b0d5-553dc2d08ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85591417-f1e7-4621-b0d5-553dc2d08ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3a4cf5-c53d-45e9-af99-b47f9400e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Volume fba28ebe-3814-40ff-b1bb-e405f635ea77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba28ebe-3814-40ff-b1bb-e405f635ea77', 'volume_size': 1} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1280692314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba28ebe-3814-40ff-b1bb-e405f635ea77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2d30485b6b4498a15027da8a0efe0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:23Z,use_quota=True,user_id='013c863101c04656bcfe6be00f31540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Creating volume fba28ebe-3814-40ff-b1bb-e405f635ea77 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:33:23 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:23 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 1073741824 Nov 06 21:33:23 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Flow 'volume_create_manager' (3a420dfe-f8c6-4d6e-b9a7-fa30a2228898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f78f7b-35d8-43c3-a054-8e0e86957df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f78f7b-35d8-43c3-a054-8e0e86957df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1482329407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73be67c8-654a-4af0-af16-f94e68561c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2d30485b6b4498a15027da8a0efe0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:24Z,use_quota=True,user_id='013c863101c04656bcfe6be00f31540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fba2ce-4c09-4bfb-ad82-00335084866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fba2ce-4c09-4bfb-ad82-00335084866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915e211a-85a7-49e0-b31d-a5148bd5f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915e211a-85a7-49e0-b31d-a5148bd5f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73be67c8-654a-4af0-af16-f94e68561c73', 'volume_name': 'volume-73be67c8-654a-4af0-af16-f94e68561c73', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5574ff38-b12d-4426-ba95-c21ee316c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5574ff38-b12d-4426-ba95-c21ee316c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eefbdac-0c30-4af5-837d-bf048b743afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:23 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Volume 73be67c8-654a-4af0-af16-f94e68561c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73be67c8-654a-4af0-af16-f94e68561c73', 'volume_size': 1} Nov 06 21:33:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:24 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 1073741824" returned: 0 in 0.550s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:24 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 Nov 06 21:33:24 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:24 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77" returned: 0 in 0.286s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1482329407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73be67c8-654a-4af0-af16-f94e68561c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2d30485b6b4498a15027da8a0efe0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:33:24Z,use_quota=True,user_id='013c863101c04656bcfe6be00f31540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Creating volume 73be67c8-654a-4af0-af16-f94e68561c73 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:33:24 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3a4cf5-c53d-45e9-af99-b47f9400e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba28ebe-3814-40ff-b1bb-e405f635ea77', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea5ae8f-e89c-4a0e-b7fa-28132ff05ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:24 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 1073741824 Nov 06 21:33:24 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:24 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Volume volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 (fba28ebe-3814-40ff-b1bb-e405f635ea77): created successfully Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea5ae8f-e89c-4a0e-b7fa-28132ff05ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Flow 'volume_create_manager' (11d74d2a-c73e-49f2-9e09-fdfe07d681f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:24 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3dcfd0fe-3abc-43e5-ba8d-1ab836a2d43e tempest-TestServerVolumeAttachmentScenario-1298427025 None] Created volume successfully. Nov 06 21:33:24 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 1073741824" returned: 0 in 0.506s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:24 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 Nov 06 21:33:24 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:25 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eefbdac-0c30-4af5-837d-bf048b743afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73be67c8-654a-4af0-af16-f94e68561c73', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a1040f-9d42-4ce4-918d-edf07f802d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:33:25 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Volume volume-73be67c8-654a-4af0-af16-f94e68561c73 (73be67c8-654a-4af0-af16-f94e68561c73): created successfully Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a1040f-9d42-4ce4-918d-edf07f802d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:33:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Flow 'volume_create_manager' (3a420dfe-f8c6-4d6e-b9a7-fa30a2228898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:33:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-73b2df24-82c9-446e-873f-a825852a031c tempest-TestServerVolumeAttachmentScenario-1298427025 None] Created volume successfully. Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:32 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:33:32 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:32 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:33:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:33:35 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:35 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-5b5489a2-ae39-4b92-acc2-715ddd43619e req-da1638d0-16de-47c9-b52f-26a20478be33 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-5b5489a2-ae39-4b92-acc2-715ddd43619e req-da1638d0-16de-47c9-b52f-26a20478be33 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-5b5489a2-ae39-4b92-acc2-715ddd43619e req-da1638d0-16de-47c9-b52f-26a20478be33 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-5b5489a2-ae39-4b92-acc2-715ddd43619e req-da1638d0-16de-47c9-b52f-26a20478be33 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-fba28ebe-3814-40ff-b1bb-e405f635ea77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d1ee231-1d29-4fdf-8ebe-356147f570f1', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:33:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-5b5489a2-ae39-4b92-acc2-715ddd43619e req-da1638d0-16de-47c9-b52f-26a20478be33 tempest-TestServerVolumeAttachmentScenario-1298427025 None] attachment_update completed successfully. Nov 06 21:33:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-8092bd9e-c655-4e08-997e-501389394f10 req-3211e634-e5ae-452d-bd6e-404591696b80 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:33:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-8092bd9e-c655-4e08-997e-501389394f10 req-3211e634-e5ae-452d-bd6e-404591696b80 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:33:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [req-8092bd9e-c655-4e08-997e-501389394f10 req-3211e634-e5ae-452d-bd6e-404591696b80 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:33:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-8092bd9e-c655-4e08-997e-501389394f10 req-3211e634-e5ae-452d-bd6e-404591696b80 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f', 'name': 'volume-73be67c8-654a-4af0-af16-f94e68561c73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55eb74f6-3d5d-48aa-a2cc-0d85fa51db26', 'enforce_multipath': True} {{(pid=87350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4997}} Nov 06 21:33:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-8092bd9e-c655-4e08-997e-501389394f10 req-3211e634-e5ae-452d-bd6e-404591696b80 tempest-TestServerVolumeAttachmentScenario-1298427025 None] attachment_update completed successfully. Nov 06 21:34:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-78df9eca-d69b-412a-9191-8b72cc3f5d07 req-35bfcd63-302e-48f5-bf3b-5e3dd6fae2b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Terminate volume connection completed successfully. Nov 06 21:34:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-78df9eca-d69b-412a-9191-8b72cc3f5d07 req-35bfcd63-302e-48f5-bf3b-5e3dd6fae2b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Deleting attachment 55eb74f6-3d5d-48aa-a2cc-0d85fa51db26. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:34:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [req-8b925527-0247-4d63-911e-f9336802e515 req-e5eeb858-4275-43b2-b1df-d7578e38867b tempest-TestServerVolumeAttachmentScenario-1298427025 None] Terminate volume connection completed successfully. Nov 06 21:34:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [req-8b925527-0247-4d63-911e-f9336802e515 req-e5eeb858-4275-43b2-b1df-d7578e38867b tempest-TestServerVolumeAttachmentScenario-1298427025 None] Deleting attachment 7d1ee231-1d29-4fdf-8ebe-356147f570f1. {{(pid=87350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5127}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "cinder-73be67c8-654a-4af0-af16-f94e68561c73-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-73be67c8-654a-4af0-af16-f94e68561c73-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "cinder-quobyte-73be67c8-654a-4af0-af16-f94e68561c73" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-quobyte-73be67c8-654a-4af0-af16-f94e68561c73" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b7d22-ba42-4476-a478-5da8f0e7863c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:07 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 Nov 06 21:34:07 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:07 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:07 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73 Nov 06 21:34:07 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:07 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-73be67c8-654a-4af0-af16-f94e68561c73" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-quobyte-73be67c8-654a-4af0-af16-f94e68561c73" released by "delete_volume" :: held 0.664s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Created reservations ['37caa95f-e4dd-4b64-abd5-8808dec140c1', '2e703c4b-a6a8-44ff-bdb9-31fdf8bdabd3', '8fd0ad6f-4e79-4b4b-8433-02a894b3d2cd', 'ccc44671-d867-4de0-90eb-8c00526edd42'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:08 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:08 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:08 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.258s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Deleted volume successfully. Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-50f8dce9-978d-4bfc-aa29-442b5c94d2ba tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-73be67c8-654a-4af0-af16-f94e68561c73-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "cinder-fba28ebe-3814-40ff-b1bb-e405f635ea77-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-fba28ebe-3814-40ff-b1bb-e405f635ea77-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "cinder-quobyte-fba28ebe-3814-40ff-b1bb-e405f635ea77" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-quobyte-fba28ebe-3814-40ff-b1bb-e405f635ea77" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ecebbd-8271-438e-99f8-495ec45dbd37]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:08 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 Nov 06 21:34:08 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:08 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77" returned: 0 in 0.367s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:08 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77 Nov 06 21:34:08 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:09 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fba28ebe-3814-40ff-b1bb-e405f635ea77" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-quobyte-fba28ebe-3814-40ff-b1bb-e405f635ea77" released by "delete_volume" :: held 0.682s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Created reservations ['cd42a0be-01e4-4ef8-b464-45d6bf4b5167', 'e8440cd8-003f-46de-8aba-a28844d6bc49', '03664b2e-0d6a-4cf8-8b01-07ab6575929a', '103a8063-5b94-49bb-bdac-65862d238dcd'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:09 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:09 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:09 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.276s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Deleted volume successfully. Nov 06 21:34:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ea48ee02-5366-4f0a-b4fe-6471383606b4 tempest-TestServerVolumeAttachmentScenario-1298427025 None] Lock "cinder-fba28ebe-3814-40ff-b1bb-e405f635ea77-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:19 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:19 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:34:23 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Flow 'volume_create_manager' (026a1b49-e145-43d1-bcbd-ffc7b52b064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed90ae95-1ee0-433f-9089-77ea8896cb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed90ae95-1ee0-433f-9089-77ea8896cb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1d4af0-60c5-4448-9614-577495de8447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7ebb59c1e1451eae93370bf8d47d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:24Z,use_quota=True,user_id='ee28d7e036b243629ec10241089b86fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb5277f-3d65-445a-be91-2adaccde2220),volume_type_id=7bb5277f-3d65-445a-be91-2adaccde2220)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffac6bb-c69f-4aca-ad88-6e2172905f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:23 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffac6bb-c69f-4aca-ad88-6e2172905f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e1c3b7-e538-4b4f-988c-5fea9f906615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e1c3b7-e538-4b4f-988c-5fea9f906615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de1d4af0-60c5-4448-9614-577495de8447', 'volume_name': 'volume-de1d4af0-60c5-4448-9614-577495de8447', 'volume_size': 1, 'image_id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5db6d85a6e1e5acb8ecf22a2ea493236', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b7ebb59c1e1451eae93370bf8d47d46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c21fbf9a071b21f5dfc8dd937f643bb985a31562df548ee727487748efa4e7899fd9ba2b0e3d80b8c4c118d035d1c14d071968bae48905001f373793bebb2f14', 'id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'created_at': datetime.datetime(2026, 11, 6, 20, 34, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 34, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4a62c6-914c-49a2-9419-c5cc74d32bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4a62c6-914c-49a2-9419-c5cc74d32bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd072c5a-cbce-44c3-aa89-fac66dfbdc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:24 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Volume de1d4af0-60c5-4448-9614-577495de8447: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de1d4af0-60c5-4448-9614-577495de8447', 'volume_size': 1, 'image_id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5db6d85a6e1e5acb8ecf22a2ea493236', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b7ebb59c1e1451eae93370bf8d47d46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c21fbf9a071b21f5dfc8dd937f643bb985a31562df548ee727487748efa4e7899fd9ba2b0e3d80b8c4c118d035d1c14d071968bae48905001f373793bebb2f14', 'id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'created_at': datetime.datetime(2026, 11, 6, 20, 34, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 34, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Trying to clone de1d4af0-60c5-4448-9614-577495de8447 from image 168e28bf-b30a-49ff-95e0-a3f3e418a55c at location (None, [{'url': 'file:///opt/stack/data/glance/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:34:24 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d7dc97-6d3e-4712-9c7b-dfa117f3094b]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:24 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD Nov 06 21:34:24 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:24 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:24 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD Nov 06 21:34:24 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:25 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Temporary image 168e28bf-b30a-49ff-95e0-a3f3e418a55c is fetched for user ee28d7e036b243629ec10241089b86fd. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c73e56-b3e1-477a-b433-1f4bc603058e]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:25 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD Nov 06 21:34:25 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:25 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:25 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD Nov 06 21:34:25 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:25 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1d4af0-60c5-4448-9614-577495de8447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7ebb59c1e1451eae93370bf8d47d46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:24Z,use_quota=True,user_id='ee28d7e036b243629ec10241089b86fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb5277f-3d65-445a-be91-2adaccde2220),volume_type_id=7bb5277f-3d65-445a-be91-2adaccde2220)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Creating volume de1d4af0-60c5-4448-9614-577495de8447 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:25 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:25 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 1073741824 Nov 06 21:34:25 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:26 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 1073741824" returned: 0 in 0.416s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:26 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 Nov 06 21:34:26 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:26 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447" returned: 0 in 0.238s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Attempting download of 168e28bf-b30a-49ff-95e0-a3f3e418a55c ((None, [{'url': 'file:///opt/stack/data/glance/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'metadata': {}}])) to volume de1d4af0-60c5-4448-9614-577495de8447. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c7542-9715-49a8-a97e-6c2802b354c7]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:26 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15 Nov 06 21:34:26 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:26 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15" returned: 0 in 0.328s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:26 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15 Nov 06 21:34:26 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:27 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15" returned: 1 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168e28bf-b30a-49ff-95e0-a3f3e418a55c_vz3afv15' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cecb9a-2b2b-4c54-a608-20a16e49cebb]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:27 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD Nov 06 21:34:27 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:27 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:27 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD Nov 06 21:34:27 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:27 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] 168e28bf-b30a-49ff-95e0-a3f3e418a55c was raw, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:34:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:27 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 Nov 06 21:34:27 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:28 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447" returned: 0 in 0.442s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_168e28bf-b30a-49ff-95e0-a3f3e418a55c_3ak9jk7cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:34:28 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:28 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 1G Nov 06 21:34:28 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:28 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 1G" returned: 0 in 0.305s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Downloaded image 168e28bf-b30a-49ff-95e0-a3f3e418a55c ((None, [{'url': 'file:///opt/stack/data/glance/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'metadata': {}}])) to volume de1d4af0-60c5-4448-9614-577495de8447 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Temporary image 168e28bf-b30a-49ff-95e0-a3f3e418a55c for user ee28d7e036b243629ec10241089b86fd is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Marking volume de1d4af0-60c5-4448-9614-577495de8447 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Copying metadata from image 168e28bf-b30a-49ff-95e0-a3f3e418a55c to de1d4af0-60c5-4448-9614-577495de8447. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Creating volume glance metadata for volume de1d4af0-60c5-4448-9614-577495de8447 backed by image 168e28bf-b30a-49ff-95e0-a3f3e418a55c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5db6d85a6e1e5acb8ecf22a2ea493236', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd072c5a-cbce-44c3-aa89-fac66dfbdc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1d4af0-60c5-4448-9614-577495de8447', 'volume_size': 1, 'image_id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5db6d85a6e1e5acb8ecf22a2ea493236', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b7ebb59c1e1451eae93370bf8d47d46', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c21fbf9a071b21f5dfc8dd937f643bb985a31562df548ee727487748efa4e7899fd9ba2b0e3d80b8c4c118d035d1c14d071968bae48905001f373793bebb2f14', 'id': '168e28bf-b30a-49ff-95e0-a3f3e418a55c', 'created_at': datetime.datetime(2026, 11, 6, 20, 34, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 34, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168e28bf-b30a-49ff-95e0-a3f3e418a55c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b286ba-eb86-4c0b-b188-bbad7d6a2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Volume volume-de1d4af0-60c5-4448-9614-577495de8447 (de1d4af0-60c5-4448-9614-577495de8447): created successfully Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b286ba-eb86-4c0b-b188-bbad7d6a2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Flow 'volume_create_manager' (026a1b49-e145-43d1-bcbd-ffc7b52b064a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b7d8e119-5f65-417d-9e1d-99339cc8b8ce tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Created volume successfully. Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Acquiring lock "cinder-de1d4af0-60c5-4448-9614-577495de8447-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "cinder-de1d4af0-60c5-4448-9614-577495de8447-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Acquiring lock "cinder-quobyte-de1d4af0-60c5-4448-9614-577495de8447" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "cinder-quobyte-de1d4af0-60c5-4448-9614-577495de8447" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e8a417-c487-4fe5-8815-305b3ffee7d8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:29 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 Nov 06 21:34:29 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:29 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447" returned: 0 in 0.364s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:29 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447 Nov 06 21:34:29 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:29 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-de1d4af0-60c5-4448-9614-577495de8447" returned: 0 in 0.255s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "cinder-quobyte-de1d4af0-60c5-4448-9614-577495de8447" released by "delete_volume" :: held 0.663s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:29 devstack cinder-volume[87350]: WARNING cinder.quota [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:34:29 devstack cinder-volume[87350]: WARNING cinder.quota [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:34:29 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Created reservations ['7c8dd0e4-4ea4-41e1-9ed2-3dffbffaa552', '1dfc904b-e2b0-45f5-8977-00fa59d45680', '7115c115-b297-406b-b2b9-5d197396f225', 'bc6280d0-36ee-443f-bd39-0c9214c33695'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:30 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:30 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:30 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.246s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Deleted volume successfully. Nov 06 21:34:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7282445c-f17e-41ce-a88c-3a92a86776f3 tempest-VolumeAndVolumeTypeFromImageTest-92447493 None] Lock "cinder-de1d4af0-60c5-4448-9614-577495de8447-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:32 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:32 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:32 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.244s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:34:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (784f3b74-7cbe-4d92-b9e9-635daa3ffbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10f2c02-5f83-4454-851d-beb97f1bbf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10f2c02-5f83-4454-851d-beb97f1bbf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-71923119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c9c148-268b-41b0-afe2-5d290b0e3aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:35Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441ff220-ba24-437a-bf1e-bce344813ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441ff220-ba24-437a-bf1e-bce344813ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16623e7d-2c00-4c72-a491-ecf6b505179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16623e7d-2c00-4c72-a491-ecf6b505179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c9c148-268b-41b0-afe2-5d290b0e3aba', 'volume_name': 'volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b029a7ef-e6f1-49f3-88ce-11ace7796f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b029a7ef-e6f1-49f3-88ce-11ace7796f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae05549b-9293-46ce-84a9-9fee3e1587fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:34 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume a2c9c148-268b-41b0-afe2-5d290b0e3aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba', 'volume_size': 1} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-71923119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c9c148-268b-41b0-afe2-5d290b0e3aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:35Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating volume a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:34 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:34 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba 1073741824 Nov 06 21:34:34 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:35 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba 1073741824" returned: 0 in 0.441s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:35 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba Nov 06 21:34:35 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:35 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba" returned: 0 in 0.245s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae05549b-9293-46ce-84a9-9fee3e1587fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b804a0d-c539-4d54-87b4-c44f86d136a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba (a2c9c148-268b-41b0-afe2-5d290b0e3aba): created successfully Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b804a0d-c539-4d54-87b4-c44f86d136a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (784f3b74-7cbe-4d92-b9e9-635daa3ffbc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0c15ec81-eea9-4da8-b253-56bebc0c0383 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created volume successfully. Nov 06 21:34:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating offline snapshot c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 of volume a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:34:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e14957-95b7-4fbc-b54f-c32395cb18a7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:37 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba Nov 06 21:34:37 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:37 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:37 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 1G Nov 06 21:34:37 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:37 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 1G" returned: 0 in 0.410s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:37 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 Nov 06 21:34:37 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:37 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" returned: 0 in 0.301s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 is being set with open permissions: ugo+rw Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 Nov 06 21:34:38 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" returned: 0 in 0.255s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info Nov 06 21:34:38 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info is being set with open permissions: ugo+rw Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info Nov 06 21:34:38 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.info" returned: 0 in 0.252s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1090c7c4-8102-4ff3-bb27-943f7474999c tempest-CreateVolumesFromSnapshotTest-843282816 None] Create snapshot completed successfully Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (a0cd0ffc-df6f-4faf-87ab-230334bf0085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3304b43f-dd63-4d21-8551-0c653b0eca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3304b43f-dd63-4d21-8551-0c653b0eca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647919159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e68d1c4-6900-4185-b3fa-4a90a5534964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:39Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01df8765-af34-4171-8465-7e34b8050ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01df8765-af34-4171-8465-7e34b8050ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3508b2e2-0704-4f42-aa3b-c90afab56faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3508b2e2-0704-4f42-aa3b-c90afab56faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e68d1c4-6900-4185-b3fa-4a90a5534964', 'volume_name': 'volume-4e68d1c4-6900-4185-b3fa-4a90a5534964', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0649ec0c-d10c-4d46-a6f7-36a340bd9dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0649ec0c-d10c-4d46-a6f7-36a340bd9dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f8a0cb-e29f-4275-bf9e-bf9440f992a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume 4e68d1c4-6900-4185-b3fa-4a90a5534964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e68d1c4-6900-4185-b3fa-4a90a5534964', 'volume_size': 1} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647919159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e68d1c4-6900-4185-b3fa-4a90a5534964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:39Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating volume 4e68d1c4-6900-4185-b3fa-4a90a5534964 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:39 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:39 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 1073741824 Nov 06 21:34:39 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (3cc4a27b-6670-45a9-b3a9-2541f9cb2f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4c9685-cdee-4711-9e74-5a371eeb74fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4c9685-cdee-4711-9e74-5a371eeb74fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-390231230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5e81e3-7ba9-4fb4-985b-4c245e11252e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:40Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ea9c1e-36d3-40cc-b55e-23f3683065e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ea9c1e-36d3-40cc-b55e-23f3683065e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413b0857-5202-4632-b477-aeff42e26e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413b0857-5202-4632-b477-aeff42e26e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5e81e3-7ba9-4fb4-985b-4c245e11252e', 'volume_name': 'volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3394e5ae-ca59-4d81-814a-7dc0bc88ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3394e5ae-ca59-4d81-814a-7dc0bc88ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d156a-462e-40aa-83a9-2f0365d0c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume ad5e81e3-7ba9-4fb4-985b-4c245e11252e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e', 'volume_size': 1} Nov 06 21:34:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:40 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 1073741824" returned: 0 in 0.531s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:40 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 Nov 06 21:34:40 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (7cf05333-367d-4b1d-9f11-5100f18ac4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d1a814-37dc-4bb4-94b0-95493c688669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d1a814-37dc-4bb4-94b0-95493c688669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573191063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e7dfe22-44b1-4552-8f10-6426b2c51950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:40Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec18ed0-6937-472e-a81f-f23499110f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec18ed0-6937-472e-a81f-f23499110f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf837b9-72f9-44c8-91a1-106d30fbe88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf837b9-72f9-44c8-91a1-106d30fbe88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e7dfe22-44b1-4552-8f10-6426b2c51950', 'volume_name': 'volume-3e7dfe22-44b1-4552-8f10-6426b2c51950', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d7310a-be2c-425f-945b-36165b6e44fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d7310a-be2c-425f-945b-36165b6e44fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f933e09-9dba-4e4a-9a72-10cda54a26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume 3e7dfe22-44b1-4552-8f10-6426b2c51950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e7dfe22-44b1-4552-8f10-6426b2c51950', 'volume_size': 1} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:40 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-390231230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5e81e3-7ba9-4fb4-985b-4c245e11252e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:40Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating volume ad5e81e3-7ba9-4fb4-985b-4c245e11252e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:40 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f8a0cb-e29f-4275-bf9e-bf9440f992a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e68d1c4-6900-4185-b3fa-4a90a5534964', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88004ed-49d3-4719-a668-d39b95463585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e 1073741824 Nov 06 21:34:40 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:40 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 (4e68d1c4-6900-4185-b3fa-4a90a5534964): created successfully Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88004ed-49d3-4719-a668-d39b95463585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (a0cd0ffc-df6f-4faf-87ab-230334bf0085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5fc25b5e-3bcc-4a7b-90ce-a215bc2d7b5d tempest-CreateVolumesFromSnapshotTest-843282816 None] Created volume successfully. Nov 06 21:34:40 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e 1073741824" returned: 0 in 0.503s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (6b9a91a1-2bbf-435b-bb9d-006de902e437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe21167-1860-435b-a6b3-8c343cfd117f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe21167-1860-435b-a6b3-8c343cfd117f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554063738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738f307d-a848-4350-a93c-4e56aa2d2394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:41Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4de3a8c-0f1c-4562-8e98-12e73f9df98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4de3a8c-0f1c-4562-8e98-12e73f9df98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdaec2f-1e84-4541-98d3-ce20985c2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdaec2f-1e84-4541-98d3-ce20985c2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738f307d-a848-4350-a93c-4e56aa2d2394', 'volume_name': 'volume-738f307d-a848-4350-a93c-4e56aa2d2394', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed24d95f-b475-4015-89e3-14772107dc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed24d95f-b475-4015-89e3-14772107dc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9863c9f3-f95c-4c8a-8a1b-2d14ea6b41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume 738f307d-a848-4350-a93c-4e56aa2d2394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738f307d-a848-4350-a93c-4e56aa2d2394', 'volume_size': 1} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:41 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e Nov 06 21:34:41 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:41 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.961s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1573191063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e7dfe22-44b1-4552-8f10-6426b2c51950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:40Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating volume 3e7dfe22-44b1-4552-8f10-6426b2c51950 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:41 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:41 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 1073741824 Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d156a-462e-40aa-83a9-2f0365d0c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57848e0b-c64e-4036-8fad-ffddf49e2803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (7e90d12e-5de5-4b14-b369-7c1843f6ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1146116-223b-458c-8761-d9aa21241cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e (ad5e81e3-7ba9-4fb4-985b-4c245e11252e): created successfully Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57848e0b-c64e-4036-8fad-ffddf49e2803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (3cc4a27b-6670-45a9-b3a9-2541f9cb2f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1146116-223b-458c-8761-d9aa21241cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486015560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5bfa5b-f623-4c65-b385-94df9e17e3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:41Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730be95e-3891-40eb-8ae4-7dbbfefb6e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730be95e-3891-40eb-8ae4-7dbbfefb6e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c333d9f0-6500-4d79-b8c7-bf4ce3e90528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c333d9f0-6500-4d79-b8c7-bf4ce3e90528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5bfa5b-f623-4c65-b385-94df9e17e3de', 'volume_name': 'volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b276ea3-7514-492f-8bae-462ed9864704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b276ea3-7514-492f-8bae-462ed9864704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270477af-91a8-499c-9d27-4fdb9e9fd2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume fc5bfa5b-f623-4c65-b385-94df9e17e3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de', 'volume_size': 1} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bff65bed-68ec-45c5-8061-41093b30c548 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created volume successfully. Nov 06 21:34:41 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 1073741824" returned: 0 in 0.411s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:41 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 Nov 06 21:34:41 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950" returned: 0 in 0.240s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554063738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738f307d-a848-4350-a93c-4e56aa2d2394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:41Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating volume 738f307d-a848-4350-a93c-4e56aa2d2394 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:42 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f933e09-9dba-4e4a-9a72-10cda54a26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e7dfe22-44b1-4552-8f10-6426b2c51950', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:42 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 1073741824 Nov 06 21:34:42 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9a69ad-8dfa-4b2b-9362-0f584ad82b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 (3e7dfe22-44b1-4552-8f10-6426b2c51950): created successfully Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9a69ad-8dfa-4b2b-9362-0f584ad82b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (7cf05333-367d-4b1d-9f11-5100f18ac4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0762617a-6dda-4720-b95d-88fb14e08597 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created volume successfully. Nov 06 21:34:42 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 1073741824" returned: 0 in 0.443s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:42 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 Nov 06 21:34:42 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394" returned: 0 in 0.236s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.269s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486015560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5bfa5b-f623-4c65-b385-94df9e17e3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d50cc34e4145808ed613a5e5fdc01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:41Z,use_quota=True,user_id='7930aadbc83348bf8801ba2f06b44c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Creating volume fc5bfa5b-f623-4c65-b385-94df9e17e3de {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:42 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9863c9f3-f95c-4c8a-8a1b-2d14ea6b41f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738f307d-a848-4350-a93c-4e56aa2d2394', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:42 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de 1073741824 Nov 06 21:34:42 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad7dcab-65eb-4f76-a0da-3268240633ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume volume-738f307d-a848-4350-a93c-4e56aa2d2394 (738f307d-a848-4350-a93c-4e56aa2d2394): created successfully Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad7dcab-65eb-4f76-a0da-3268240633ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (6b9a91a1-2bbf-435b-bb9d-006de902e437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-eb51bb08-b5d3-4da1-a2c9-79147a0ef043 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created volume successfully. Nov 06 21:34:43 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de 1073741824" returned: 0 in 0.415s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de Nov 06 21:34:43 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:43 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de" returned: 0 in 0.242s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (270477af-91a8-499c-9d27-4fdb9e9fd2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5e937c-485a-4b31-9cd1-b1ba081258fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Volume volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de (fc5bfa5b-f623-4c65-b385-94df9e17e3de): created successfully Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5e937c-485a-4b31-9cd1-b1ba081258fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Flow 'volume_create_manager' (7e90d12e-5de5-4b14-b369-7c1843f6ba16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-85346b07-c711-448b-83de-0a44fe52dd7e tempest-CreateVolumesFromSnapshotTest-843282816 None] Created volume successfully. Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-fc5bfa5b-f623-4c65-b385-94df9e17e3de-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-fc5bfa5b-f623-4c65-b385-94df9e17e3de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-fc5bfa5b-f623-4c65-b385-94df9e17e3de" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-fc5bfa5b-f623-4c65-b385-94df9e17e3de" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9d895-c03a-4e9c-8f24-e7a1bb854218]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:43 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de Nov 06 21:34:43 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de" returned: 0 in 0.363s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:44 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de Nov 06 21:34:44 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc5bfa5b-f623-4c65-b385-94df9e17e3de" returned: 0 in 0.244s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-fc5bfa5b-f623-4c65-b385-94df9e17e3de" released by "delete_volume" :: held 0.647s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['2959ad4a-1287-4edf-afdc-a0595fdcad1e', 'b243b70b-f5d9-411e-a88b-78253766dcf3', '4bc9603b-67b1-420a-9bd2-c2904f6fe9dc', '966be9c7-8418-4014-8978-f9d1c44de182'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:44 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:44 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:44 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.242s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleted volume successfully. Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-25169bdb-936a-4e08-be34-00f78f2e1582 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-fc5bfa5b-f623-4c65-b385-94df9e17e3de-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-738f307d-a848-4350-a93c-4e56aa2d2394-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-738f307d-a848-4350-a93c-4e56aa2d2394-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-738f307d-a848-4350-a93c-4e56aa2d2394" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-738f307d-a848-4350-a93c-4e56aa2d2394" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[113af082-9f0f-4d03-8179-2d4a59acf0cc]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:44 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 Nov 06 21:34:44 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394" returned: 0 in 0.362s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:45 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394 Nov 06 21:34:45 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-738f307d-a848-4350-a93c-4e56aa2d2394" returned: 0 in 0.233s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-738f307d-a848-4350-a93c-4e56aa2d2394" released by "delete_volume" :: held 0.632s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['2f331c49-ebeb-4ddc-bba4-d03af6bcd954', '9bbd49d1-0509-4ed6-8c9c-69b171cbc473', '942231c7-4aac-45a1-9fb7-b718675c2567', 'ddf5f52b-b217-4364-a9d9-e3471710f0bf'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:45 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:45 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:45 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.235s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleted volume successfully. Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2c85c2e-95aa-4691-81a2-094af90d3554 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-738f307d-a848-4350-a93c-4e56aa2d2394-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-3e7dfe22-44b1-4552-8f10-6426b2c51950-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-3e7dfe22-44b1-4552-8f10-6426b2c51950-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-3e7dfe22-44b1-4552-8f10-6426b2c51950" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-3e7dfe22-44b1-4552-8f10-6426b2c51950" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a5c55-b853-40ad-90d5-dcb949b163b0]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:46 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 Nov 06 21:34:46 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:46 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950" returned: 0 in 0.343s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:46 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950 Nov 06 21:34:46 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:46 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3e7dfe22-44b1-4552-8f10-6426b2c51950" returned: 0 in 0.233s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-3e7dfe22-44b1-4552-8f10-6426b2c51950" released by "delete_volume" :: held 0.615s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['61281a2a-3d96-493c-b212-d9687ae4cce4', 'ad09fa5e-3d38-4200-a7d5-dfe515b45aa5', 'c1fbf40f-a1de-4445-ac42-f2be7d6be071', '25e03fbf-eacc-4444-b904-36cb85c23aa8'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:46 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:46 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:46 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.244s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:46 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleted volume successfully. Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6e0363c0-f4a1-444e-9ad5-924ab8f839b2 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-3e7dfe22-44b1-4552-8f10-6426b2c51950-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-ad5e81e3-7ba9-4fb4-985b-4c245e11252e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-ad5e81e3-7ba9-4fb4-985b-4c245e11252e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-ad5e81e3-7ba9-4fb4-985b-4c245e11252e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-ad5e81e3-7ba9-4fb4-985b-4c245e11252e" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d794226c-63f4-49a9-a062-c4e9c17bc611]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:47 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e Nov 06 21:34:47 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:47 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e" returned: 0 in 0.355s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:47 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e Nov 06 21:34:47 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:47 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ad5e81e3-7ba9-4fb4-985b-4c245e11252e" returned: 0 in 0.244s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-ad5e81e3-7ba9-4fb4-985b-4c245e11252e" released by "delete_volume" :: held 0.643s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['9234cfe3-5327-44f5-af9e-fe47777f785d', '73866ee4-5b99-437d-86a6-81a6a283e160', '5b05d920-4fcc-4fd9-8364-1e771cc1ce63', '1d9f5941-4319-4d6a-9df2-d12908d3e0ea'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:47 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:47 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:48 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.242s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleted volume successfully. Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8430e5d-1b73-4e0b-86ee-7ffa247d2df5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-ad5e81e3-7ba9-4fb4-985b-4c245e11252e-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-4e68d1c4-6900-4185-b3fa-4a90a5534964-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-4e68d1c4-6900-4185-b3fa-4a90a5534964-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-4e68d1c4-6900-4185-b3fa-4a90a5534964" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-4e68d1c4-6900-4185-b3fa-4a90a5534964" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[51effa0e-f8d6-4eb2-9e5a-0c7e1dbc7dff]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:48 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 Nov 06 21:34:48 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:48 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964" returned: 0 in 0.340s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:48 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964 Nov 06 21:34:48 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:48 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4e68d1c4-6900-4185-b3fa-4a90a5534964" returned: 0 in 0.244s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-4e68d1c4-6900-4185-b3fa-4a90a5534964" released by "delete_volume" :: held 0.620s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['a328efa9-f91a-4521-aa17-66721066fcf4', '92802c91-66b4-4271-9ac7-c9470bfc81b2', '1852b5aa-992e-469b-b59c-8048cce6ce50', '26496799-4fb0-453f-8a97-3a5147be7039'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:49 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:49 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:49 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.241s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleted volume successfully. Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-67dcc248-c96c-4e9f-a817-9f92ae688e92 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-4e68d1c4-6900-4185-b3fa-4a90a5534964-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-c2cc0754-6a61-4e90-91c3-f4d72e87fbe5-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-c2cc0754-6a61-4e90-91c3-f4d72e87fbe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-a2c9c148-268b-41b0-afe2-5d290b0e3aba" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-a2c9c148-268b-41b0-afe2-5d290b0e3aba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleting offline snapshot c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 of volume a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] snapshot_file for this snap is: volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9742a25-4af6-4261-8fa6-28e286881e39]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:49 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 Nov 06 21:34:49 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:49 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1300c315-d618-4e79-9131-b10f6227c79d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:50 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba Nov 06 21:34:50 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:50 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba" returned: 0 in 0.377s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:50 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 Nov 06 21:34:50 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:50 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" returned: 0 in 0.320s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:50 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5 Nov 06 21:34:50 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:50 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba.c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" returned: 0 in 0.238s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-c2cc0754-6a61-4e90-91c3-f4d72e87fbe5" released by "_delete_snapshot" :: held 1.405s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-a2c9c148-268b-41b0-afe2-5d290b0e3aba" released by "delete_snapshot" :: held 1.427s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['404fffc0-078b-4da9-a910-fdfe1c0a6ed6', '0153453b-c849-4377-a7ba-dfcee79beaed', '75391e9a-39b1-4cf7-a1bd-9aa60763caa3', '2c1fc66c-b1ea-4a8b-89a1-111a74387768'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Delete snapshot completed successfully. Nov 06 21:34:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-abc1dc5f-231e-4170-becf-b5fe95b612e5 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-c2cc0754-6a61-4e90-91c3-f4d72e87fbe5-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-a2c9c148-268b-41b0-afe2-5d290b0e3aba-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-a2c9c148-268b-41b0-afe2-5d290b0e3aba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "cinder-quobyte-a2c9c148-268b-41b0-afe2-5d290b0e3aba" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:34:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-a2c9c148-268b-41b0-afe2-5d290b0e3aba" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:34:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b401d8d2-1dc0-496e-91b4-07552fe5b7b4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:34:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:51 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba Nov 06 21:34:51 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:52 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba" returned: 0 in 0.348s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:52 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba Nov 06 21:34:52 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:52 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a2c9c148-268b-41b0-afe2-5d290b0e3aba" returned: 0 in 0.252s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-quobyte-a2c9c148-268b-41b0-afe2-5d290b0e3aba" released by "delete_volume" :: held 0.663s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Created reservations ['9b843158-af9f-4564-adab-71a44b7c3d43', 'e6f10a46-a79a-48c6-a984-b49103545dfa', 'ce834692-9b7b-4cfc-9a5b-1199ee4f4344', '7a41c3bc-ef5e-4d93-80ce-8996aa9814e1'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:52 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:34:52 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:52 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.236s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Deleted volume successfully. Nov 06 21:34:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2ce5bb33-56c3-47b0-a307-27782619fd56 tempest-CreateVolumesFromSnapshotTest-843282816 None] Lock "cinder-a2c9c148-268b-41b0-afe2-5d290b0e3aba-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (932921ee-f742-4fe6-899b-fd7853a121fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c73488f-0a09-491c-afd2-f765c8c6e3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c73488f-0a09-491c-afd2-f765c8c6e3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847233969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17365606-c8a5-47f4-83fe-d74d7788ef13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:55Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34ef8cc-e9bf-46f8-8790-028d823b730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34ef8cc-e9bf-46f8-8790-028d823b730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199fe0cb-09e4-491a-8fe3-690eb13f2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199fe0cb-09e4-491a-8fe3-690eb13f2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17365606-c8a5-47f4-83fe-d74d7788ef13', 'volume_name': 'volume-17365606-c8a5-47f4-83fe-d74d7788ef13', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e936386-9b5a-4cde-a824-482b3496bd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e936386-9b5a-4cde-a824-482b3496bd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd1c971-b821-4807-97d6-08965d176137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:55 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume 17365606-c8a5-47f4-83fe-d74d7788ef13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17365606-c8a5-47f4-83fe-d74d7788ef13', 'volume_size': 1} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847233969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17365606-c8a5-47f4-83fe-d74d7788ef13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:55Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Creating volume 17365606-c8a5-47f4-83fe-d74d7788ef13 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:55 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:55 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 1073741824 Nov 06 21:34:55 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:55 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 1073741824" returned: 0 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:55 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 Nov 06 21:34:55 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:56 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13" returned: 0 in 0.235s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd1c971-b821-4807-97d6-08965d176137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17365606-c8a5-47f4-83fe-d74d7788ef13', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc3dd24-9238-4eb7-89ee-2e7981f938af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:56 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume volume-17365606-c8a5-47f4-83fe-d74d7788ef13 (17365606-c8a5-47f4-83fe-d74d7788ef13): created successfully Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc3dd24-9238-4eb7-89ee-2e7981f938af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (932921ee-f742-4fe6-899b-fd7853a121fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0658741f-5491-4cf0-98d4-2509b77270fa tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created volume successfully. Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (32226bf6-6d6f-4548-8f2c-ae913222c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35503f89-1146-47c5-862f-a6bfdc893b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35503f89-1146-47c5-862f-a6bfdc893b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101853728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e8ddf8-cf4d-4727-96b3-62386a2f21c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:57Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375fb741-47ca-4787-b007-49e3ed82b9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375fb741-47ca-4787-b007-49e3ed82b9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8220c7-a25f-49ea-9bb8-31e363999e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8220c7-a25f-49ea-9bb8-31e363999e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e8ddf8-cf4d-4727-96b3-62386a2f21c8', 'volume_name': 'volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcafa96-58fd-448e-a88d-b30f54cf5cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcafa96-58fd-448e-a88d-b30f54cf5cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c096345b-67d4-481b-befa-c50ca61ac311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:56 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume a4e8ddf8-cf4d-4727-96b3-62386a2f21c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8', 'volume_size': 1} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101853728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e8ddf8-cf4d-4727-96b3-62386a2f21c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:57Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Creating volume a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:57 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:57 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 1073741824 Nov 06 21:34:57 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (4c237e34-0a9a-416f-a864-c0907f4f65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7336d4-d6b7-4a74-b53d-0290e9a99f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7336d4-d6b7-4a74-b53d-0290e9a99f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2032718970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c0ee9-f55f-4e53-ba67-fc2739f5d920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:57Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d105a1-e2bd-47fa-a6aa-d1254775f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d105a1-e2bd-47fa-a6aa-d1254775f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd4cf44-8ae5-4aae-926c-b677790c46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd4cf44-8ae5-4aae-926c-b677790c46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1c0ee9-f55f-4e53-ba67-fc2739f5d920', 'volume_name': 'volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204881e0-d5cf-4f35-9818-0a86623c23d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204881e0-d5cf-4f35-9818-0a86623c23d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8697370-ca0c-4565-a032-fc74649bd121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume ab1c0ee9-f55f-4e53-ba67-fc2739f5d920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920', 'volume_size': 1} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:57 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 1073741824" returned: 0 in 0.541s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:57 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 Nov 06 21:34:57 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (f815e086-a7a2-4809-9e57-6dd1f7174443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227e115a-e08b-4f65-b942-29dc2c3172e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227e115a-e08b-4f65-b942-29dc2c3172e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057854863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abdab5-186f-468a-bacd-6520be0153fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:58Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f80bff5-4577-4143-8fb3-03f00ed1471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f80bff5-4577-4143-8fb3-03f00ed1471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef812e1-0372-43e5-a530-fe311a02d6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef812e1-0372-43e5-a530-fe311a02d6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70abdab5-186f-468a-bacd-6520be0153fb', 'volume_name': 'volume-70abdab5-186f-468a-bacd-6520be0153fb', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5517da50-5b93-481c-8d54-9c4555e60c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5517da50-5b93-481c-8d54-9c4555e60c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed63d4-d1a7-4ad1-a74e-f028181ae38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume 70abdab5-186f-468a-bacd-6520be0153fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70abdab5-186f-468a-bacd-6520be0153fb', 'volume_size': 1} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:57 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2032718970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1c0ee9-f55f-4e53-ba67-fc2739f5d920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:57Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Creating volume ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:57 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c096345b-67d4-481b-befa-c50ca61ac311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 1073741824 Nov 06 21:34:57 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67643510-cf5d-4f42-80a3-073692d91323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:57 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 (a4e8ddf8-cf4d-4727-96b3-62386a2f21c8): created successfully Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67643510-cf5d-4f42-80a3-073692d91323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (32226bf6-6d6f-4548-8f2c-ae913222c608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-88ae6f14-e7d8-43de-8807-107dadd7a95b tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created volume successfully. Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (8807fe6b-e9dd-425c-b92b-8f5ac180174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5e0c16-095f-4664-81a5-f0f5059ed146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5e0c16-095f-4664-81a5-f0f5059ed146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1561160592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b277c883-7927-416e-bc73-f065be23c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:58Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acb4c09-2ca0-4df4-bf59-9228774f3fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acb4c09-2ca0-4df4-bf59-9228774f3fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e8d77b-8807-4adb-b794-efeac2467f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e8d77b-8807-4adb-b794-efeac2467f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b277c883-7927-416e-bc73-f065be23c631', 'volume_name': 'volume-b277c883-7927-416e-bc73-f065be23c631', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77073d67-eb20-47e7-84a8-32770088c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77073d67-eb20-47e7-84a8-32770088c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2434cc7a-dc0a-472b-a2b0-973bf17ff9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume b277c883-7927-416e-bc73-f065be23c631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b277c883-7927-416e-bc73-f065be23c631', 'volume_size': 1} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:58 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 1073741824" returned: 0 in 0.483s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:58 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 Nov 06 21:34:58 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (74f40b96-a894-4e6c-a216-af7125dcbfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005f4f9-5c83-4d0a-81f0-bf4e52206721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005f4f9-5c83-4d0a-81f0-bf4e52206721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655793838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afd0d0d-948f-4871-bffa-1c5033a6c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:58Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc996b2-592a-4706-9528-17cd1bd9f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc996b2-592a-4706-9528-17cd1bd9f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb404f0-4d02-43aa-a784-4e81bc6af171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb404f0-4d02-43aa-a784-4e81bc6af171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0afd0d0d-948f-4871-bffa-1c5033a6c0b2', 'volume_name': 'volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b79da9-9a21-4f86-9aea-653165919aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b79da9-9a21-4f86-9aea-653165919aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeebad8-e6d2-4209-9171-46fc634dad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume 0afd0d0d-948f-4871-bffa-1c5033a6c0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2', 'volume_size': 1} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:58 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920" returned: 0 in 0.243s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057854863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abdab5-186f-468a-bacd-6520be0153fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:58Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Creating volume 70abdab5-186f-468a-bacd-6520be0153fb {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:58 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:58 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb 1073741824 Nov 06 21:34:58 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8697370-ca0c-4565-a032-fc74649bd121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9330048-ac0c-4e4d-b33d-b50260d3f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 (ab1c0ee9-f55f-4e53-ba67-fc2739f5d920): created successfully Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9330048-ac0c-4e4d-b33d-b50260d3f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (4c237e34-0a9a-416f-a864-c0907f4f65c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:58 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-999a7d86-e782-48d6-b5a5-a1a543a33cec tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created volume successfully. Nov 06 21:34:59 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb 1073741824" returned: 0 in 0.412s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:59 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb Nov 06 21:34:59 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:59 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb" returned: 0 in 0.238s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1561160592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b277c883-7927-416e-bc73-f065be23c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:58Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Creating volume b277c883-7927-416e-bc73-f065be23c631 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:34:59 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed63d4-d1a7-4ad1-a74e-f028181ae38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70abdab5-186f-468a-bacd-6520be0153fb', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:59 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 1073741824 Nov 06 21:34:59 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9164fd-2acd-44e2-850d-45479ada2788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:34:59 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume volume-70abdab5-186f-468a-bacd-6520be0153fb (70abdab5-186f-468a-bacd-6520be0153fb): created successfully Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9164fd-2acd-44e2-850d-45479ada2788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (f815e086-a7a2-4809-9e57-6dd1f7174443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:34:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1cacf50b-2c41-4fcb-aa72-6f46f941bd8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created volume successfully. Nov 06 21:34:59 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 1073741824" returned: 0 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:59 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 Nov 06 21:34:59 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:59 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631" returned: 0 in 0.230s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655793838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afd0d0d-948f-4871-bffa-1c5033a6c0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99770cdf4334f6c8136485df27c815e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:34:58Z,use_quota=True,user_id='e75777fb196b4d1cb44a29cdac62cc15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Creating volume 0afd0d0d-948f-4871-bffa-1c5033a6c0b2 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:00 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2434cc7a-dc0a-472b-a2b0-973bf17ff9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b277c883-7927-416e-bc73-f065be23c631', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 1073741824 Nov 06 21:35:00 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449ff107-9e44-48aa-a8ca-ba882b53752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume volume-b277c883-7927-416e-bc73-f065be23c631 (b277c883-7927-416e-bc73-f065be23c631): created successfully Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449ff107-9e44-48aa-a8ca-ba882b53752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (8807fe6b-e9dd-425c-b92b-8f5ac180174b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2bd0786a-9059-4a7c-82b8-ef569c8a387f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created volume successfully. Nov 06 21:35:00 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 1073741824" returned: 0 in 0.423s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:00 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 Nov 06 21:35:00 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:00 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2" returned: 0 in 0.251s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeebad8-e6d2-4209-9171-46fc634dad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0981d47a-0023-479f-bdfc-41da5f1b1879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Volume volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 (0afd0d0d-948f-4871-bffa-1c5033a6c0b2): created successfully Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0981d47a-0023-479f-bdfc-41da5f1b1879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Flow 'volume_create_manager' (74f40b96-a894-4e6c-a216-af7125dcbfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:00 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-050085a9-8883-4032-bc05-871ed437a776 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created volume successfully. Nov 06 21:35:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-0afd0d0d-948f-4871-bffa-1c5033a6c0b2-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-0afd0d0d-948f-4871-bffa-1c5033a6c0b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-quobyte-0afd0d0d-948f-4871-bffa-1c5033a6c0b2" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-0afd0d0d-948f-4871-bffa-1c5033a6c0b2" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:01 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846b1e5-22e2-42fa-ae15-a8cde4333952]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:02 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 Nov 06 21:35:02 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:02 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2" returned: 0 in 0.344s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:02 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2 Nov 06 21:35:02 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:02 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0afd0d0d-948f-4871-bffa-1c5033a6c0b2" returned: 0 in 0.237s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-0afd0d0d-948f-4871-bffa-1c5033a6c0b2" released by "delete_volume" :: held 0.622s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created reservations ['4f127804-967a-4755-9f13-6d6d5e8d3848', '40aed06f-5b1b-4c41-b9bc-5c568063c42e', 'd7e2a353-1895-4831-ab38-ed438f8d23d3', '2f347840-bae5-44a5-b0be-0ac959c2dd0d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:02 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:02 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:02 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.253s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Deleted volume successfully. Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-3f985828-3ab8-44e4-bf26-255b7ec0bb8e tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-0afd0d0d-948f-4871-bffa-1c5033a6c0b2-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-b277c883-7927-416e-bc73-f065be23c631-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-b277c883-7927-416e-bc73-f065be23c631-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-quobyte-b277c883-7927-416e-bc73-f065be23c631" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-b277c883-7927-416e-bc73-f065be23c631" acquired by "delete_volume" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155df6b-44f8-4bd0-ac75-3e2e1f52ff7b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:03 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 Nov 06 21:35:03 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:03 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:03 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631 Nov 06 21:35:03 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:03 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b277c883-7927-416e-bc73-f065be23c631" returned: 0 in 0.241s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-b277c883-7927-416e-bc73-f065be23c631" released by "delete_volume" :: held 0.653s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created reservations ['256731ca-ec21-4e36-99be-3c9b0e865b13', 'ef31d86f-b0c4-49c1-a8f6-2e9a6af1e663', '1b3a53e6-c857-4ad3-9a1f-7bd22ae0b0e6', '652f98d0-c3af-40d3-b29c-21637dbd4e10'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:03 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:03 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:04 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.237s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:04 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Deleted volume successfully. Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-da0c1fd6-5e08-4d23-a5d5-4f8aab10305f tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-b277c883-7927-416e-bc73-f065be23c631-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-70abdab5-186f-468a-bacd-6520be0153fb-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-70abdab5-186f-468a-bacd-6520be0153fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-quobyte-70abdab5-186f-468a-bacd-6520be0153fb" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-70abdab5-186f-468a-bacd-6520be0153fb" acquired by "delete_volume" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b9286-a6ac-43ca-8680-e621fa59f781]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:04 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb Nov 06 21:35:04 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:04 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb" returned: 0 in 0.344s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:04 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb Nov 06 21:35:04 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:04 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-70abdab5-186f-468a-bacd-6520be0153fb" returned: 0 in 0.238s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-70abdab5-186f-468a-bacd-6520be0153fb" released by "delete_volume" :: held 0.623s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created reservations ['22071a56-b032-4773-8fa1-45e629c64a04', '00c7fe3d-5cb9-4a18-a0c2-cbfcbe7ddcbf', '98d1bbd1-47fb-4e6f-bf5b-9e58e6517347', 'f00d642a-9954-4573-9d83-3099060fb483'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:04 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:04 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:05 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.254s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Deleted volume successfully. Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9baff282-6b24-423c-b714-826d4332650d tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-70abdab5-186f-468a-bacd-6520be0153fb-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-quobyte-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9c3684-e7af-4c72-b50d-857fee2fd425]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:05 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 Nov 06 21:35:05 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:05 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920" returned: 0 in 0.352s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:05 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920 Nov 06 21:35:05 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920" returned: 0 in 0.229s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920" released by "delete_volume" :: held 0.621s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created reservations ['02f18aa4-5438-4dd1-b43c-7e2c4a356db8', '85923bc0-33c1-4e6f-9042-3a2a42d54abc', '0df57405-ddc4-432c-8307-af18d3228aca', '77392c5d-5e26-43fb-a14d-80870c52d187'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:06 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.241s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:06 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Deleted volume successfully. Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-60dbd623-2858-4197-a9d6-84d14a26a588 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-ab1c0ee9-f55f-4e53-ba67-fc2739f5d920-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-quobyte-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8" acquired by "delete_volume" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f797813-d632-46e3-bd2f-d7e9a550ffa4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 Nov 06 21:35:06 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:06 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8" returned: 0 in 0.359s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:06 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:06 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8 Nov 06 21:35:06 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:07 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8" returned: 0 in 0.258s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8" released by "delete_volume" :: held 0.658s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created reservations ['1fb209b0-bbc4-4baa-b7b2-500dab5d7b74', 'dfb90668-0653-4a22-ac92-60efda5e9f58', '8685babc-c016-4d81-aa7d-4f63a4388dda', '7b9dbeff-33fb-4af3-90f4-6c138cbad637'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:07 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:07 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:07 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.248s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Deleted volume successfully. Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-87ad79b4-0a0f-41fd-a3e4-06ec64c29259 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-a4e8ddf8-cf4d-4727-96b3-62386a2f21c8-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-17365606-c8a5-47f4-83fe-d74d7788ef13-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-17365606-c8a5-47f4-83fe-d74d7788ef13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "cinder-quobyte-17365606-c8a5-47f4-83fe-d74d7788ef13" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-17365606-c8a5-47f4-83fe-d74d7788ef13" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc7129-2d72-49c3-94d9-3c659d4dd80b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:07 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 Nov 06 21:35:07 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13" returned: 0 in 0.358s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13 Nov 06 21:35:08 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-17365606-c8a5-47f4-83fe-d74d7788ef13" returned: 0 in 0.235s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-quobyte-17365606-c8a5-47f4-83fe-d74d7788ef13" released by "delete_volume" :: held 0.635s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Created reservations ['efabb8be-3265-48bf-a815-5e67dc8e3ded', 'fa37aa47-ec3d-4723-b5b1-4c25e2c41d0c', '237552d5-8d7f-4900-af16-a84c26fb9602', '5afba8f3-70bd-4987-acfc-98efcbff728e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:08 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:08 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:08 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.247s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:08 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Deleted volume successfully. Nov 06 21:35:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9bb65670-3f43-404c-8cda-2c29d91b1f18 tempest-CreateVolumesFromSourceVolumeTest-1803400209 None] Lock "cinder-17365606-c8a5-47f4-83fe-d74d7788ef13-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:18 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=113,cinder:UPDATE=149,cinder:INSERT=32,cinder:DELETE=13 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:18 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=155,cinder:SELECT=100,cinder:INSERT=48,cinder:DELETE=14 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (2351bffd-335b-41c6-8c20-545c0734657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c0ff68-850d-4b79-9c1a-e1977cd7ba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c0ff68-850d-4b79-9c1a-e1977cd7ba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497857114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fe7f52-eb49-40ee-a4dc-a7f4ee73463f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:25Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ba6666-8bdf-494b-990d-caf103eab68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ba6666-8bdf-494b-990d-caf103eab68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07eb2988-84ec-4343-b09a-3e2944fca0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07eb2988-84ec-4343-b09a-3e2944fca0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fe7f52-eb49-40ee-a4dc-a7f4ee73463f', 'volume_name': 'volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc626986-ca25-4f59-a5bd-81b4f1e40a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc626986-ca25-4f59-a5bd-81b4f1e40a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64726c2e-7015-447e-ad3a-e452cafa6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:24 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Volume 42fe7f52-eb49-40ee-a4dc-a7f4ee73463f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f', 'volume_size': 1} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497857114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fe7f52-eb49-40ee-a4dc-a7f4ee73463f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:25Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Creating volume 42fe7f52-eb49-40ee-a4dc-a7f4ee73463f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:25 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:25 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f 1073741824 Nov 06 21:35:25 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:25 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f 1073741824" returned: 0 in 0.685s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (b6b8ce1e-068c-4f4b-9783-1e2a69272c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3836a92c-63e5-41a6-844c-d8ff92b6d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:25 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f Nov 06 21:35:25 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (85574a3b-8072-4a5d-a120-e3d9e54d97cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d267980-d315-4506-a762-5b5685cdebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3836a92c-63e5-41a6-844c-d8ff92b6d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676274955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2209de25-c647-452a-af68-188df9f8691d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d116493f-fd17-462a-bd9f-78cdcf213e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d116493f-fd17-462a-bd9f-78cdcf213e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e317f39-fdd2-4c49-a2e6-ae7896b13c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e317f39-fdd2-4c49-a2e6-ae7896b13c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2209de25-c647-452a-af68-188df9f8691d', 'volume_name': 'volume-2209de25-c647-452a-af68-188df9f8691d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4859ef07-bd5a-4ead-9c53-b1bb6ee76f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4859ef07-bd5a-4ead-9c53-b1bb6ee76f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c25ced6-8d59-4fcb-b8b3-f132a63ce9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume 2209de25-c647-452a-af68-188df9f8691d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2209de25-c647-452a-af68-188df9f8691d', 'volume_size': 1} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d267980-d315-4506-a762-5b5685cdebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1920630029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688e5222-e63b-4d39-bd37-da62857fb1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b95dd4-6f6d-45a7-9d93-98ae8972ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b95dd4-6f6d-45a7-9d93-98ae8972ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8856e81e-122e-45cb-8a0a-9c7c83e34f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8856e81e-122e-45cb-8a0a-9c7c83e34f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688e5222-e63b-4d39-bd37-da62857fb1f9', 'volume_name': 'volume-688e5222-e63b-4d39-bd37-da62857fb1f9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105ccd1d-56ae-4494-90ba-62b2d54aa6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105ccd1d-56ae-4494-90ba-62b2d54aa6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a80662a-e05f-4333-bad0-9138ff95202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:25 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume 688e5222-e63b-4d39-bd37-da62857fb1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688e5222-e63b-4d39-bd37-da62857fb1f9', 'volume_size': 1} Nov 06 21:35:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (1494c5c7-4773-4d68-954c-fafd3ab465b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d6deff-e352-42d4-84b6-1a03b928792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d6deff-e352-42d4-84b6-1a03b928792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-224124071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a79b73-cd45-4d02-a739-52f0e9f79e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011fd9a8-1bc5-45e7-8dc5-0e4a4f321bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011fd9a8-1bc5-45e7-8dc5-0e4a4f321bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5952a5-2444-4b19-bd3e-3f5d50b19ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5952a5-2444-4b19-bd3e-3f5d50b19ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a79b73-cd45-4d02-a739-52f0e9f79e8f', 'volume_name': 'volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65455c7e-b59e-4755-8700-05a8ead6e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65455c7e-b59e-4755-8700-05a8ead6e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1114e4-0c6b-4b90-84b0-c48fec4bfb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Volume 94a79b73-cd45-4d02-a739-52f0e9f79e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f', 'volume_size': 1} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.260s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676274955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2209de25-c647-452a-af68-188df9f8691d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating volume 2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64726c2e-7015-447e-ad3a-e452cafa6a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d 1073741824 Nov 06 21:35:26 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955cc7eb-72bd-4f5b-ad01-f51052723e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Volume volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f (42fe7f52-eb49-40ee-a4dc-a7f4ee73463f): created successfully Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955cc7eb-72bd-4f5b-ad01-f51052723e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (2351bffd-335b-41c6-8c20-545c0734657e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (7dc49217-3969-4a6e-bd83-cdde2893e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa42148a-632f-471d-8beb-4700d4a0e6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c1171868-6fa8-44b3-8592-2bfa70b2fc80 tempest-CreateVolumesFromImageTest-1994533691 None] Created volume successfully. Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa42148a-632f-471d-8beb-4700d4a0e6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837064536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4478a3f0-d232-4a61-9bec-650f6f21af37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14844c62-7198-4efe-b84e-7d0410bd16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14844c62-7198-4efe-b84e-7d0410bd16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b6a107-6bd5-4e8b-9452-ce0aba5e4925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b6a107-6bd5-4e8b-9452-ce0aba5e4925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4478a3f0-d232-4a61-9bec-650f6f21af37', 'volume_name': 'volume-4478a3f0-d232-4a61-9bec-650f6f21af37', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787fc7ba-69ef-485b-9047-d798bfbfac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787fc7ba-69ef-485b-9047-d798bfbfac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6961d8-8827-4425-a417-c98ba790c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Volume 4478a3f0-d232-4a61-9bec-650f6f21af37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4478a3f0-d232-4a61-9bec-650f6f21af37', 'volume_size': 1} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (d716082d-539a-4dac-8f13-c307d6ace089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941e58ac-7e9e-4f98-9bd6-1759b9b64cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941e58ac-7e9e-4f98-9bd6-1759b9b64cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-232451954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54607544-22ed-4705-97de-a147ee6a790c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:27Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc68ad75-3c47-4ab0-8b82-17387f8a9221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc68ad75-3c47-4ab0-8b82-17387f8a9221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7688a4f8-8f76-4126-8216-d9744f4965ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7688a4f8-8f76-4126-8216-d9744f4965ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54607544-22ed-4705-97de-a147ee6a790c', 'volume_name': 'volume-54607544-22ed-4705-97de-a147ee6a790c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fb8f9b-af0b-44b9-97e9-7ff07a5d50b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fb8f9b-af0b-44b9-97e9-7ff07a5d50b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec820b78-921a-490d-a2da-dfba5ff1cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Volume 54607544-22ed-4705-97de-a147ee6a790c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54607544-22ed-4705-97de-a147ee6a790c', 'volume_size': 1} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:26 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d 1073741824" returned: 0 in 0.629s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:26 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d Nov 06 21:35:26 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:27 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d" returned: 0 in 0.306s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1920630029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688e5222-e63b-4d39-bd37-da62857fb1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Creating volume 688e5222-e63b-4d39-bd37-da62857fb1f9 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:27 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:27 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 1073741824 Nov 06 21:35:27 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (aca0e861-4203-44e5-9c64-91ad3fe69129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333c43fd-11b4-4b0e-b755-bcec2311f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c25ced6-8d59-4fcb-b8b3-f132a63ce9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2209de25-c647-452a-af68-188df9f8691d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d603f501-814e-488f-a356-e953ea337529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333c43fd-11b4-4b0e-b755-bcec2311f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340484911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e892c-4273-46b2-a64a-49a98a5797a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:27Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612c94f3-ffb3-42a1-8ea9-416e31f59878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612c94f3-ffb3-42a1-8ea9-416e31f59878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539adc33-9bf6-4be5-8dd4-1b17fcbf3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539adc33-9bf6-4be5-8dd4-1b17fcbf3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3e892c-4273-46b2-a64a-49a98a5797a2', 'volume_name': 'volume-eb3e892c-4273-46b2-a64a-49a98a5797a2', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4bbc1d-6e5b-40d3-861c-54df316d6419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4bbc1d-6e5b-40d3-861c-54df316d6419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a08ac83-c9e9-43d0-8f26-7fab4a3d7291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Volume eb3e892c-4273-46b2-a64a-49a98a5797a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3e892c-4273-46b2-a64a-49a98a5797a2', 'volume_size': 1} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume volume-2209de25-c647-452a-af68-188df9f8691d (2209de25-c647-452a-af68-188df9f8691d): created successfully Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d603f501-814e-488f-a356-e953ea337529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (b6b8ce1e-068c-4f4b-9783-1e2a69272c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0d41bdff-42d3-474e-9ee0-0fb20a301778 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created volume successfully. Nov 06 21:35:27 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 1073741824" returned: 0 in 0.535s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:27 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 Nov 06 21:35:27 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9" returned: 0 in 0.293s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-224124071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a79b73-cd45-4d02-a739-52f0e9f79e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Creating volume 94a79b73-cd45-4d02-a739-52f0e9f79e8f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:28 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f 1073741824 Nov 06 21:35:28 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a80662a-e05f-4333-bad0-9138ff95202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688e5222-e63b-4d39-bd37-da62857fb1f9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d1239-9a07-4c70-8ba1-e6e234c379e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume volume-688e5222-e63b-4d39-bd37-da62857fb1f9 (688e5222-e63b-4d39-bd37-da62857fb1f9): created successfully Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d1239-9a07-4c70-8ba1-e6e234c379e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (85574a3b-8072-4a5d-a120-e3d9e54d97cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a0047e7f-d295-4361-9436-c6ab2020963a tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created volume successfully. Nov 06 21:35:28 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f 1073741824" returned: 0 in 0.438s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f Nov 06 21:35:28 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f" returned: 0 in 0.267s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.296s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837064536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4478a3f0-d232-4a61-9bec-650f6f21af37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:26Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Creating volume 4478a3f0-d232-4a61-9bec-650f6f21af37 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:28 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1114e4-0c6b-4b90-84b0-c48fec4bfb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f011c4d-16fb-4c6a-b7cd-4a103e24a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:28 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 1073741824 Nov 06 21:35:28 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Volume volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f (94a79b73-cd45-4d02-a739-52f0e9f79e8f): created successfully Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f011c4d-16fb-4c6a-b7cd-4a103e24a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (1494c5c7-4773-4d68-954c-fafd3ab465b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-610a491e-d29d-433f-88aa-99f158ec1ef1 tempest-CreateVolumesFromImageTest-1994533691 None] Created volume successfully. Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (f80ea158-1d30-404f-b36c-dd0c2d57fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc557df9-1b14-46b0-8c85-f1600d606291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc557df9-1b14-46b0-8c85-f1600d606291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850670179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51255020-a05a-4aa5-a681-d70206209705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:29Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66006433-acba-4016-93bb-073a91aaee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66006433-acba-4016-93bb-073a91aaee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0483d2c8-e112-478c-8b1f-27459214e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0483d2c8-e112-478c-8b1f-27459214e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51255020-a05a-4aa5-a681-d70206209705', 'volume_name': 'volume-51255020-a05a-4aa5-a681-d70206209705', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fbdd88-f1c2-4037-9610-814e0b076a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fbdd88-f1c2-4037-9610-814e0b076a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f544252d-0bef-4ea0-8eef-86bac7f25adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume 51255020-a05a-4aa5-a681-d70206209705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51255020-a05a-4aa5-a681-d70206209705', 'volume_size': 1} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:29 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 1073741824" returned: 0 in 0.620s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 Nov 06 21:35:29 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (cfe1e945-54e1-4128-9304-eeed444d3dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3500a89-825f-4121-816b-6a7b83863d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3500a89-825f-4121-816b-6a7b83863d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1098962428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665382af-19a5-41c7-aaf8-f7835b43dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:30Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e23621-b2d0-4c6d-bbbd-5fb0d682095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e23621-b2d0-4c6d-bbbd-5fb0d682095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95143964-21dc-4bee-b5e0-a09b2f1a9762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95143964-21dc-4bee-b5e0-a09b2f1a9762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665382af-19a5-41c7-aaf8-f7835b43dc2d', 'volume_name': 'volume-665382af-19a5-41c7-aaf8-f7835b43dc2d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb4e377-d554-47d7-9d47-a5ee313b7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb4e377-d554-47d7-9d47-a5ee313b7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc8a846-ebca-4629-a7d8-cc00218f5f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume 665382af-19a5-41c7-aaf8-f7835b43dc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665382af-19a5-41c7-aaf8-f7835b43dc2d', 'volume_size': 1} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:29 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37" returned: 0 in 0.352s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-232451954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54607544-22ed-4705-97de-a147ee6a790c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:27Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Creating volume 54607544-22ed-4705-97de-a147ee6a790c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:29 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6961d8-8827-4425-a417-c98ba790c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4478a3f0-d232-4a61-9bec-650f6f21af37', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11affcf1-31a0-47b1-b4bd-104e310a1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:29 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c 1073741824 Nov 06 21:35:29 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:29 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Volume volume-4478a3f0-d232-4a61-9bec-650f6f21af37 (4478a3f0-d232-4a61-9bec-650f6f21af37): created successfully Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11affcf1-31a0-47b1-b4bd-104e310a1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:29 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (7dc49217-3969-4a6e-bd83-cdde2893e048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b3e7fee8-55ca-4be2-83a0-f22667a4c24a tempest-CreateVolumesFromImageTest-1994533691 None] Created volume successfully. Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Flow 'volume_create_manager' (29c35576-e60e-454f-92e8-aff2c98dc45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818c53b2-9a2e-47ba-a4bc-d0372159fd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818c53b2-9a2e-47ba-a4bc-d0372159fd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ac1c7b-f56d-4232-9530-db1ac490ca54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4bb1cebac44af7984b38cf09358f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:30Z,use_quota=True,user_id='b68fac77441e49309a83abbb38400f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad146a93-174d-4098-8a0f-6db74570d5bf),volume_type_id=ad146a93-174d-4098-8a0f-6db74570d5bf)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6eada4a-4950-4f53-bc6f-8d6feb95b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6eada4a-4950-4f53-bc6f-8d6feb95b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c1fc1f-ee75-4af0-9fe6-7245000bf60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (811d5944-01cf-40cb-b4a0-1ff9df66fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8499564-5466-4e89-8939-b94c12f7ccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8499564-5466-4e89-8939-b94c12f7ccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781401036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf6495d-a8f2-49ea-a973-0012dd5101e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:30Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dca33d3-a1fa-4253-bd1b-cce1d30810ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dca33d3-a1fa-4253-bd1b-cce1d30810ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3003c0bf-93c9-48ab-b005-4370abbe2a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3003c0bf-93c9-48ab-b005-4370abbe2a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf6495d-a8f2-49ea-a973-0012dd5101e7', 'volume_name': 'volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26738087-b89b-438b-b2e8-3594e2ee4b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26738087-b89b-438b-b2e8-3594e2ee4b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbcafb7-ab18-45e8-bc06-befb4bdd814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume bdf6495d-a8f2-49ea-a973-0012dd5101e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7', 'volume_size': 1} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:30 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c 1073741824" returned: 0 in 0.639s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c Nov 06 21:35:30 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (94b953da-c7a4-48db-bd89-45546fa37a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44cb406-7b21-4da2-91d2-03805a3df2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44cb406-7b21-4da2-91d2-03805a3df2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451320721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92fb4ad-0641-4583-8426-75ff36f536d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:31Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5507c1f7-5c91-4ccb-99bf-a441fd5a3aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5507c1f7-5c91-4ccb-99bf-a441fd5a3aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a50ddf5-4f5f-4f94-a8d8-10cbe65940d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a50ddf5-4f5f-4f94-a8d8-10cbe65940d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92fb4ad-0641-4583-8426-75ff36f536d9', 'volume_name': 'volume-c92fb4ad-0641-4583-8426-75ff36f536d9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a35cfa-d20e-4b47-bb37-dffdb4b6c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a35cfa-d20e-4b47-bb37-dffdb4b6c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5fcc35-69d5-40e0-bd41-529f4ba6aaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume c92fb4ad-0641-4583-8426-75ff36f536d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92fb4ad-0641-4583-8426-75ff36f536d9', 'volume_size': 1} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c1fc1f-ee75-4af0-9fe6-7245000bf60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08ac1c7b-f56d-4232-9530-db1ac490ca54', 'volume_name': 'volume-08ac1c7b-f56d-4232-9530-db1ac490ca54', 'volume_size': 1, 'image_id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '932034517a720ec8b4c7b17c3d78a553', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d4bb1cebac44af7984b38cf09358f66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e07ad3a5f096b8fada99d09e5246de1a12201c70468cd89fc1d7b78258d056b43778f2efc9a2db75daaaf5f575b9b45f369eb5faae7434ecdc4b9b3a7ef5a469', 'id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c18611a-208f-49bc-b674-a99ae1603e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c18611a-208f-49bc-b674-a99ae1603e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d534dc-6f00-4d57-825a-2f510cc606c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Volume 08ac1c7b-f56d-4232-9530-db1ac490ca54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08ac1c7b-f56d-4232-9530-db1ac490ca54', 'volume_size': 1, 'image_id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '932034517a720ec8b4c7b17c3d78a553', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d4bb1cebac44af7984b38cf09358f66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e07ad3a5f096b8fada99d09e5246de1a12201c70468cd89fc1d7b78258d056b43778f2efc9a2db75daaaf5f575b9b45f369eb5faae7434ecdc4b9b3a7ef5a469', 'id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Trying to clone 08ac1c7b-f56d-4232-9530-db1ac490ca54 from image 6f019ca4-775e-4750-a52d-9a660ee1ccfc at location (None, [{'url': 'file:///opt/stack/data/glance/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:35:30 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:35:30 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c" returned: 0 in 0.313s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.587s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340484911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e892c-4273-46b2-a64a-49a98a5797a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da3ec680854e27b37093d24191b0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:27Z,use_quota=True,user_id='e62856482e484018892cc3158b848bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Creating volume eb3e892c-4273-46b2-a64a-49a98a5797a2 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:30 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec820b78-921a-490d-a2da-dfba5ff1cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54607544-22ed-4705-97de-a147ee6a790c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1bd868-1b54-4b40-8cb4-4ed366fbe366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:30 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 1073741824 Nov 06 21:35:30 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c2afa-791e-4c14-a53a-075666a2cdfc]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Volume volume-54607544-22ed-4705-97de-a147ee6a790c (54607544-22ed-4705-97de-a147ee6a790c): created successfully Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1bd868-1b54-4b40-8cb4-4ed366fbe366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (d716082d-539a-4dac-8f13-c307d6ace089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7dac8501-3c26-4901-9c96-142c916fd936 tempest-CreateVolumesFromImageTest-1994533691 None] Created volume successfully. Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (59a38180-9a59-4ddd-9450-57f5a691155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a71c19-5764-49e1-854f-0fc13d07f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a71c19-5764-49e1-854f-0fc13d07f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494330217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac16555-821a-4f20-8758-aea264c514d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:31Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3812e8bd-c830-459d-ae69-fc977b5418ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3812e8bd-c830-459d-ae69-fc977b5418ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47036ab1-f3c8-4bc8-a1c1-f14a0b7f1a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47036ab1-f3c8-4bc8-a1c1-f14a0b7f1a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac16555-821a-4f20-8758-aea264c514d4', 'volume_name': 'volume-aac16555-821a-4f20-8758-aea264c514d4', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b55204-c2f4-454c-8a47-56501cef2c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b55204-c2f4-454c-8a47-56501cef2c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedad361-14b0-4cc0-880a-c78a906d7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:31 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD Nov 06 21:35:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume aac16555-821a-4f20-8758-aea264c514d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac16555-821a-4f20-8758-aea264c514d4', 'volume_size': 1} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:31 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 1073741824" returned: 0 in 0.602s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD Nov 06 21:35:31 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 Nov 06 21:35:31 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:31 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Temporary image 6f019ca4-775e-4750-a52d-9a660ee1ccfc is fetched for user b68fac77441e49309a83abbb38400f2d. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:35:31 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2" returned: 0 in 0.234s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.094s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a08ac83-c9e9-43d0-8f26-7fab4a3d7291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3e892c-4273-46b2-a64a-49a98a5797a2', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83b53f1-fe3e-40e1-934e-b15a26602f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating offline snapshot bfb563b6-8307-4098-bce4-62597b22693d of volume 2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Volume volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 (eb3e892c-4273-46b2-a64a-49a98a5797a2): created successfully Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83b53f1-fe3e-40e1-934e-b15a26602f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Flow 'volume_create_manager' (aca0e861-4203-44e5-9c64-91ad3fe69129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ca04c-6d1f-461e-9c39-3dd3089fef41]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aec273-95e1-4dcf-a632-a56e7fe26d4e]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-fe722912-13c5-471f-b175-f5e604c87795 tempest-CreateVolumesFromImageTest-1994533691 None] Created volume successfully. Nov 06 21:35:32 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d Nov 06 21:35:32 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD Nov 06 21:35:32 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:32 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-eb3e892c-4273-46b2-a64a-49a98a5797a2-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d" returned: 0 in 0.450s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-eb3e892c-4273-46b2-a64a-49a98a5797a2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:32 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d 1G Nov 06 21:35:32 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-quobyte-eb3e892c-4273-46b2-a64a-49a98a5797a2" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:32 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD Nov 06 21:35:32 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-eb3e892c-4273-46b2-a64a-49a98a5797a2" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:32 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.338s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[be196995-32d9-48d0-bf2f-990fad774a20]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:35:32 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 Nov 06 21:35:32 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:32 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d 1G" returned: 0 in 0.474s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2209de25-c647-452a-af68-188df9f8691d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2209de25-c647-452a-af68-188df9f8691d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d Nov 06 21:35:32 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:32 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2" returned: 0 in 0.414s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:32 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2 Nov 06 21:35:32 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2209de25-c647-452a-af68-188df9f8691d -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d" returned: 0 in 0.319s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d is being set with open permissions: ugo+rw Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d Nov 06 21:35:33 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-eb3e892c-4273-46b2-a64a-49a98a5797a2" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-eb3e892c-4273-46b2-a64a-49a98a5797a2" released by "delete_volume" :: held 0.754s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Created reservations ['856afc3b-6dac-4a6f-b0de-5977e1e7ea4a', 'b2ae836c-76db-4ed3-b5eb-fd1a317b9d16', '1017cf53-95cb-4804-82b1-a3dce925de81', '4a166c25-abc7-47bb-bb42-30a5b7e599be'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:33 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info Nov 06 21:35:33 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-54607544-22ed-4705-97de-a147ee6a790c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-54607544-22ed-4705-97de-a147ee6a790c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-quobyte-54607544-22ed-4705-97de-a147ee6a790c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-54607544-22ed-4705-97de-a147ee6a790c" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[15056d1a-1158-4cc8-a6b2-7c01c2f339e2]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.296s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Deleted volume successfully. Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-be1a8c4e-fb7f-4dc8-ad56-9e4c08e2b7fb tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-eb3e892c-4273-46b2-a64a-49a98a5797a2-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:33 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c Nov 06 21:35:33 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:33 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:33 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info is being set with open permissions: ugo+rw Nov 06 21:35:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:33 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info Nov 06 21:35:33 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c" returned: 0 in 0.398s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.info" returned: 0 in 0.270s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c Nov 06 21:35:34 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.772s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850670179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51255020-a05a-4aa5-a681-d70206209705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:29Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Creating volume 51255020-a05a-4aa5-a681-d70206209705 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:34 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 1073741824 Nov 06 21:35:34 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cfc3532c-4755-4ce8-90e8-795f0f3b94c2 tempest-CreateVolumesFromSnapshotTest-66592129 None] Create snapshot completed successfully Nov 06 21:35:34 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-54607544-22ed-4705-97de-a147ee6a790c" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-54607544-22ed-4705-97de-a147ee6a790c" released by "delete_volume" :: held 0.774s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Created reservations ['14332dd6-5b44-4d84-a906-323e98ce954f', 'cf198851-8328-4984-ba49-3afae35ba64b', '81f5787b-3b36-43cf-a645-96f03b7aa9de', '257ee28d-cf98-4b57-958f-0feaf9202090'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:34 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 1073741824" returned: 0 in 0.537s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 Nov 06 21:35:34 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-4478a3f0-d232-4a61-9bec-650f6f21af37-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-4478a3f0-d232-4a61-9bec-650f6f21af37-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-quobyte-4478a3f0-d232-4a61-9bec-650f6f21af37" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-4478a3f0-d232-4a61-9bec-650f6f21af37" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:34 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Deleted volume successfully. Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eed858-d08b-4dac-a5cc-e0456aee1367]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f8fe3839-ef6b-4695-8e6d-fde18c6657ad tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-54607544-22ed-4705-97de-a147ee6a790c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:34 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.206s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1098962428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665382af-19a5-41c7-aaf8-f7835b43dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:30Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Creating volume 665382af-19a5-41c7-aaf8-f7835b43dc2d {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:34 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 Nov 06 21:35:34 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:34 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d 1073741824 Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f544252d-0bef-4ea0-8eef-86bac7f25adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51255020-a05a-4aa5-a681-d70206209705', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ff56e1-0fe2-4287-b154-18ac1a1bcf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume volume-51255020-a05a-4aa5-a681-d70206209705 (51255020-a05a-4aa5-a681-d70206209705): created successfully Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ff56e1-0fe2-4287-b154-18ac1a1bcf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (f80ea158-1d30-404f-b36c-dd0c2d57fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b1f7a6f7-2186-496a-bda4-a1764a5ae65b tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created volume successfully. Nov 06 21:35:35 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37" returned: 0 in 0.397s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37 Nov 06 21:35:35 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d 1073741824" returned: 0 in 0.545s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d Nov 06 21:35:35 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4478a3f0-d232-4a61-9bec-650f6f21af37" returned: 0 in 0.378s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-4478a3f0-d232-4a61-9bec-650f6f21af37" released by "delete_volume" :: held 0.850s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Created reservations ['26465cd9-b471-44e6-b56f-94f1289b4459', 'a4e48365-43ba-4367-9ad9-b9eaf0810245', '4e069da4-cb16-4856-a1ae-5041e9131d94', '6a70b3c7-5c9f-4b12-b3ed-0bec095e6e5a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (6df8eb48-396d-435f-8e56-6e2323f15f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a092475f-8b18-4a52-a1da-fd6b6a7af139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a092475f-8b18-4a52-a1da-fd6b6a7af139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1059837214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d988e2e-85f9-4336-b654-0c5451fd3d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:36Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172709cf-d42d-4457-8cb8-74ebae4d35ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172709cf-d42d-4457-8cb8-74ebae4d35ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51487af-b258-42a0-8c5b-d2f2fc1ca79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51487af-b258-42a0-8c5b-d2f2fc1ca79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d988e2e-85f9-4336-b654-0c5451fd3d53', 'volume_name': 'volume-2d988e2e-85f9-4336-b654-0c5451fd3d53', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418b3fef-ff09-4fcb-acd4-4f2a4b7dca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418b3fef-ff09-4fcb-acd4-4f2a4b7dca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f8aa85-7f9a-443e-b308-de263f93a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume 2d988e2e-85f9-4336-b654-0c5451fd3d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d988e2e-85f9-4336-b654-0c5451fd3d53', 'volume_size': 1} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d" returned: 0 in 0.328s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.462s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-781401036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf6495d-a8f2-49ea-a973-0012dd5101e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:30Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Creating volume bdf6495d-a8f2-49ea-a973-0012dd5101e7 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:35 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc8a846-ebca-4629-a7d8-cc00218f5f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665382af-19a5-41c7-aaf8-f7835b43dc2d', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8957941-b0f5-4bfd-aa6b-eb1f066c005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:35 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 1073741824 Nov 06 21:35:35 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume volume-665382af-19a5-41c7-aaf8-f7835b43dc2d (665382af-19a5-41c7-aaf8-f7835b43dc2d): created successfully Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8957941-b0f5-4bfd-aa6b-eb1f066c005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (cfe1e945-54e1-4128-9304-eeed444d3dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f0548732-2da2-4201-bae7-6da989051743 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created volume successfully. Nov 06 21:35:36 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:36 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (fd4fccaf-356b-4ab9-94c1-6fb21020943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945a75b8-9eb6-45ec-b661-3c7954397719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945a75b8-9eb6-45ec-b661-3c7954397719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058412032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973f1252-9f99-4e65-9887-9d2822f45d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:36Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9937f48c-5f27-44d1-8174-b8b3400690f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9937f48c-5f27-44d1-8174-b8b3400690f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50598078-8569-4fd5-86d2-9cb9d424850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50598078-8569-4fd5-86d2-9cb9d424850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973f1252-9f99-4e65-9887-9d2822f45d2e', 'volume_name': 'volume-973f1252-9f99-4e65-9887-9d2822f45d2e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a7c4e2-364a-407b-af20-79c2f31c1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a7c4e2-364a-407b-af20-79c2f31c1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec103acc-fc5d-4cfc-b858-4cdea7dd85fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume 973f1252-9f99-4e65-9887-9d2822f45d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973f1252-9f99-4e65-9887-9d2822f45d2e', 'volume_size': 1} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:36 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.377s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:36 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Deleted volume successfully. Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6caa3aa2-57dc-4f04-a277-fb944fa5cc61 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-4478a3f0-d232-4a61-9bec-650f6f21af37-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:36 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 1073741824" returned: 0 in 0.617s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (5fbd0c87-e8ab-465e-8eb2-d24ac9692f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f35291c-ae32-4db0-92db-38501bfcc94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f35291c-ae32-4db0-92db-38501bfcc94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1810810628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ac2c2b-2de4-4709-b2e4-dcd7b94d022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:37Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcdadac-9001-49b9-93a0-9cb1024d98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcdadac-9001-49b9-93a0-9cb1024d98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 Nov 06 21:35:36 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27030098-30f4-448e-99c0-236c2896beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27030098-30f4-448e-99c0-236c2896beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ac2c2b-2de4-4709-b2e4-dcd7b94d022c', 'volume_name': 'volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e01f17-a123-436d-b5bd-26bfd72223d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e01f17-a123-436d-b5bd-26bfd72223d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7644b0-4e29-4380-83ad-0b6fbef564ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:36 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume 08ac2c2b-2de4-4709-b2e4-dcd7b94d022c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c', 'volume_size': 1} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:36 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7" returned: 0 in 0.303s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.211s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451320721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92fb4ad-0641-4583-8426-75ff36f536d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:31Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Creating volume c92fb4ad-0641-4583-8426-75ff36f536d9 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:36 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:37 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 1073741824 Nov 06 21:35:37 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-94a79b73-cd45-4d02-a739-52f0e9f79e8f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbcafb7-ab18-45e8-bc06-befb4bdd814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9595103a-5f8d-49ec-953f-ce63b6bcf09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 (bdf6495d-a8f2-49ea-a973-0012dd5101e7): created successfully Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9595103a-5f8d-49ec-953f-ce63b6bcf09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (811d5944-01cf-40cb-b4a0-1ff9df66fb16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-94a79b73-cd45-4d02-a739-52f0e9f79e8f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (493553d7-7eb2-470e-b7cf-26bee1c00ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574fd693-7e5b-48eb-8601-8bd33bd86073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f5bbb185-2e5c-40b2-a019-497d95d1d0fb tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created volume successfully. Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574fd693-7e5b-48eb-8601-8bd33bd86073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640932024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7c56c4-4775-49bd-89c1-ee2f03df177b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:37Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36703779-cd02-47e2-b517-635a3b152b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36703779-cd02-47e2-b517-635a3b152b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75659a03-5236-4467-83a0-a833d8b0eca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75659a03-5236-4467-83a0-a833d8b0eca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7c56c4-4775-49bd-89c1-ee2f03df177b', 'volume_name': 'volume-da7c56c4-4775-49bd-89c1-ee2f03df177b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0e0bb1-3fcf-49f3-8ee4-de1adaba3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0e0bb1-3fcf-49f3-8ee4-de1adaba3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1477855b-f8e4-4a4b-ba6a-7f93868a855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume da7c56c4-4775-49bd-89c1-ee2f03df177b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7c56c4-4775-49bd-89c1-ee2f03df177b', 'volume_size': 1} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-quobyte-94a79b73-cd45-4d02-a739-52f0e9f79e8f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-94a79b73-cd45-4d02-a739-52f0e9f79e8f" acquired by "delete_volume" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1315e2-eae0-4b66-b49c-9f75f5a112ee]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:37 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f Nov 06 21:35:37 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (7a8fb12a-9ca6-4768-9b7f-a26fd12103c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8588486-4e16-4305-9e13-b0f9c0e46182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 1073741824" returned: 0 in 0.556s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8588486-4e16-4305-9e13-b0f9c0e46182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1505072767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af59bd3f-e86b-4b7b-bd34-6687306ea9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:37Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a5f7cd-0640-445a-917d-d046f49a6e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a5f7cd-0640-445a-917d-d046f49a6e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3400d2d0-9c93-4e18-b04f-1a1bf62fdc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3400d2d0-9c93-4e18-b04f-1a1bf62fdc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af59bd3f-e86b-4b7b-bd34-6687306ea9ed', 'volume_name': 'volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ebff4a-d5f8-469a-baae-3b1f9f6ee988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ebff4a-d5f8-469a-baae-3b1f9f6ee988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a514c66-d759-44e5-b434-237f21f62339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume af59bd3f-e86b-4b7b-bd34-6687306ea9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed', 'volume_size': 1} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:37 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 Nov 06 21:35:37 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:37 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f" returned: 0 in 0.403s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:37 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f Nov 06 21:35:37 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:37 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.682s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494330217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac16555-821a-4f20-8758-aea264c514d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c5aa478d844d019dab258453d74b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:31Z,use_quota=True,user_id='14336980c4414a3cab2e5c4427fa35c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Creating volume aac16555-821a-4f20-8758-aea264c514d4 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5fcc35-69d5-40e0-bd41-529f4ba6aaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92fb4ad-0641-4583-8426-75ff36f536d9', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa634e7-6cb9-47ec-b9fb-e5f7159e4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:37 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 1073741824 Nov 06 21:35:37 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume volume-c92fb4ad-0641-4583-8426-75ff36f536d9 (c92fb4ad-0641-4583-8426-75ff36f536d9): created successfully Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa634e7-6cb9-47ec-b9fb-e5f7159e4947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (94b953da-c7a4-48db-bd89-45546fa37a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8ce07866-449b-4174-b75b-f6ad295c99e5 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created volume successfully. Nov 06 21:35:37 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-94a79b73-cd45-4d02-a739-52f0e9f79e8f" returned: 0 in 0.315s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-94a79b73-cd45-4d02-a739-52f0e9f79e8f" released by "delete_volume" :: held 0.775s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Created reservations ['c640f79d-4477-4498-b2cd-ee09008c328e', 'f8b59164-bc6f-4615-82d7-d0194e4b8dd6', '2e5f150b-4283-4783-beef-a524984edc6a', 'eff1b162-caf6-4c45-941b-91cf898572f3'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:38 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "cinder-quobyte-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f034127-3182-49ef-93a0-4b6e36b51caf]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 1073741824" returned: 0 in 0.604s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f Nov 06 21:35:38 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.367s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Deleted volume successfully. Nov 06 21:35:38 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 Nov 06 21:35:38 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ad63b501-4126-41a8-8065-e2c5c1499f03 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-94a79b73-cd45-4d02-a739-52f0e9f79e8f-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:38 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4" returned: 0 in 0.264s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.114s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ac1c7b-f56d-4232-9530-db1ac490ca54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4bb1cebac44af7984b38cf09358f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:30Z,use_quota=True,user_id='b68fac77441e49309a83abbb38400f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad146a93-174d-4098-8a0f-6db74570d5bf),volume_type_id=ad146a93-174d-4098-8a0f-6db74570d5bf)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Creating volume 08ac1c7b-f56d-4232-9530-db1ac490ca54 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f" returned: 0 in 0.422s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 1073741824 Nov 06 21:35:38 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedad361-14b0-4cc0-880a-c78a906d7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac16555-821a-4f20-8758-aea264c514d4', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f436d6d4-d459-436b-b643-9b52a3f5761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:38 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f Nov 06 21:35:38 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Volume volume-aac16555-821a-4f20-8758-aea264c514d4 (aac16555-821a-4f20-8758-aea264c514d4): created successfully Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f436d6d4-d459-436b-b643-9b52a3f5761f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Flow 'volume_create_manager' (59a38180-9a59-4ddd-9450-57f5a691155c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5c9fb49e-8ade-485c-b4a9-848f4a91ef81 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created volume successfully. Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-aac16555-821a-4f20-8758-aea264c514d4-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:39 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-aac16555-821a-4f20-8758-aea264c514d4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-quobyte-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f" released by "delete_volume" :: held 0.777s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-quobyte-aac16555-821a-4f20-8758-aea264c514d4" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-aac16555-821a-4f20-8758-aea264c514d4" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cc4202-0d10-4388-b4bf-4e7b73958476]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Created reservations ['00e8a1c7-480d-4e13-914f-8a7a03a2e197', '54184768-e5b0-4665-9f68-9c769b05a4f6', '09243eaf-d665-405f-b962-96bd96f3345b', '3a8ed117-7275-4bcf-9fc6-8d78c4813525'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 1073741824" returned: 0 in 0.545s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:39 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 Nov 06 21:35:39 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 Nov 06 21:35:39 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.285s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Deleted volume successfully. Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5568c59d-c93e-4895-ad4b-781d360a7581 tempest-CreateVolumesFromImageTest-1994533691 None] Lock "cinder-42fe7f52-eb49-40ee-a4dc-a7f4ee73463f-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:39 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54" returned: 0 in 0.299s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:39 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1059837214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d988e2e-85f9-4336-b654-0c5451fd3d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:36Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating volume 2d988e2e-85f9-4336-b654-0c5451fd3d53 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:39 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4" returned: 0 in 0.491s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:39 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 1073741824 Nov 06 21:35:39 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4 Nov 06 21:35:39 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Attempting download of 6f019ca4-775e-4750-a52d-9a660ee1ccfc ((None, [{'url': 'file:///opt/stack/data/glance/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'metadata': {}}])) to volume 08ac1c7b-f56d-4232-9530-db1ac490ca54. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ae89a-82fc-4630-b0a7-465668386e6d]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-aac16555-821a-4f20-8758-aea264c514d4" returned: 0 in 0.302s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-aac16555-821a-4f20-8758-aea264c514d4" released by "delete_volume" :: held 0.849s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:40 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn Nov 06 21:35:40 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created reservations ['da682efa-d84a-469d-aee2-71a3c32e4c8a', '8e387e4c-02b3-40d3-b885-bf918641fce8', '1cb9dd6b-f4ed-45f2-b16b-0fc522ff8a14', 'e11491d4-292c-4a75-9937-8d1643f8898a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:40 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-c92fb4ad-0641-4583-8426-75ff36f536d9-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:40 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 1073741824" returned: 0 in 0.660s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-c92fb4ad-0641-4583-8426-75ff36f536d9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:40 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn" returned: 0 in 0.559s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 Nov 06 21:35:40 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-quobyte-c92fb4ad-0641-4583-8426-75ff36f536d9" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-c92fb4ad-0641-4583-8426-75ff36f536d9" acquired by "delete_volume" :: waited 0.045s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:40 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn Nov 06 21:35:40 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846ea6a-0324-4ea7-87e6-85f8f43c5d47]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.421s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Deleted volume successfully. Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7ac2e82e-21c1-4fe4-8d07-0eb5e55e6e2d tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-aac16555-821a-4f20-8758-aea264c514d4-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:40 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 Nov 06 21:35:40 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:40 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53" returned: 0 in 0.422s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:40 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.587s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058412032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973f1252-9f99-4e65-9887-9d2822f45d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:36Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating volume 973f1252-9f99-4e65-9887-9d2822f45d2e {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:40 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn" returned: 1 in 0.501s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f019ca4-775e-4750-a52d-9a660ee1ccfc_yng_nwrn' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38cc333-4f9c-4397-9968-b23b19c33e98]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:40 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e 1073741824 Nov 06 21:35:40 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f8aa85-7f9a-443e-b308-de263f93a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d988e2e-85f9-4336-b654-0c5451fd3d53', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:40 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b69459-bd14-4313-8fc8-44edda06a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:41 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 (2d988e2e-85f9-4336-b654-0c5451fd3d53): created successfully Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b69459-bd14-4313-8fc8-44edda06a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (6df8eb48-396d-435f-8e56-6e2323f15f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0afd95d5-24fd-43d1-89f3-e4112b318830 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created volume successfully. Nov 06 21:35:41 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD Nov 06 21:35:41 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9" returned: 0 in 0.483s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:41 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9 Nov 06 21:35:41 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:41 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-c92fb4ad-0641-4583-8426-75ff36f536d9" returned: 0 in 0.334s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-c92fb4ad-0641-4583-8426-75ff36f536d9" released by "delete_volume" :: held 0.908s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:41 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD Nov 06 21:35:41 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e 1073741824" returned: 0 in 0.629s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created reservations ['0f2ceb1c-6de7-4fb9-84a2-8a3da2a023c2', '7db74b86-ca8f-4566-9a7e-6255c5e45ca2', 'e47d2199-c676-4b6d-a67e-ac036b7b266b', '4e76ca5a-fad0-4115-9a77-9ff943935184'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:41 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e Nov 06 21:35:41 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:41 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:41 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD" returned: 1 in 0.463s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] 6f019ca4-775e-4750-a52d-9a660ee1ccfc was raw, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:35:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:41 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 Nov 06 21:35:41 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:41 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e" returned: 0 in 0.362s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.315s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1810810628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ac2c2b-2de4-4709-b2e4-dcd7b94d022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:37Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating volume 08ac2c2b-2de4-4709-b2e4-dcd7b94d022c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:42 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:42 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c 1073741824 Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec103acc-fc5d-4cfc-b858-4cdea7dd85fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973f1252-9f99-4e65-9887-9d2822f45d2e', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:42 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab060a8-16ee-4836-a577-37a1101dcf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume volume-973f1252-9f99-4e65-9887-9d2822f45d2e (973f1252-9f99-4e65-9887-9d2822f45d2e): created successfully Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab060a8-16ee-4836-a577-37a1101dcf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (fd4fccaf-356b-4ab9-94c1-6fb21020943a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:42 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-323bd1b8-8f1d-4966-a791-75570c672332 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created volume successfully. Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.353s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Deleted volume successfully. Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-eaaa89cc-d61a-49f8-902a-be7488286ba0 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-c92fb4ad-0641-4583-8426-75ff36f536d9-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:42 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54" returned: 0 in 0.622s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6f019ca4-775e-4750-a52d-9a660ee1ccfc_sn6xc77ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:35:42 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:42 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 1G Nov 06 21:35:42 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:42 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c 1073741824" returned: 0 in 0.535s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:42 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c Nov 06 21:35:42 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-bdf6495d-a8f2-49ea-a973-0012dd5101e7-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-bdf6495d-a8f2-49ea-a973-0012dd5101e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-quobyte-bdf6495d-a8f2-49ea-a973-0012dd5101e7" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-bdf6495d-a8f2-49ea-a973-0012dd5101e7" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7798c5-7c9b-4be1-8193-1a4d4515efea]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:42 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 1G" returned: 0 in 0.425s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Downloaded image 6f019ca4-775e-4750-a52d-9a660ee1ccfc ((None, [{'url': 'file:///opt/stack/data/glance/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'metadata': {}}])) to volume 08ac1c7b-f56d-4232-9530-db1ac490ca54 successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Temporary image 6f019ca4-775e-4750-a52d-9a660ee1ccfc for user b68fac77441e49309a83abbb38400f2d is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Marking volume 08ac1c7b-f56d-4232-9530-db1ac490ca54 as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Copying metadata from image 6f019ca4-775e-4750-a52d-9a660ee1ccfc to 08ac1c7b-f56d-4232-9530-db1ac490ca54. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:35:42 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Creating volume glance metadata for volume 08ac1c7b-f56d-4232-9530-db1ac490ca54 backed by image 6f019ca4-775e-4750-a52d-9a660ee1ccfc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '932034517a720ec8b4c7b17c3d78a553', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:35:42 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 Nov 06 21:35:42 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d534dc-6f00-4d57-825a-2f510cc606c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ac1c7b-f56d-4232-9530-db1ac490ca54', 'volume_size': 1, 'image_id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '932034517a720ec8b4c7b17c3d78a553', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d4bb1cebac44af7984b38cf09358f66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e07ad3a5f096b8fada99d09e5246de1a12201c70468cd89fc1d7b78258d056b43778f2efc9a2db75daaaf5f575b9b45f369eb5faae7434ecdc4b9b3a7ef5a469', 'id': '6f019ca4-775e-4750-a52d-9a660ee1ccfc', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f019ca4-775e-4750-a52d-9a660ee1ccfc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cef095-105d-450c-9a5c-c9632129efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Volume volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 (08ac1c7b-f56d-4232-9530-db1ac490ca54): created successfully Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cef095-105d-450c-9a5c-c9632129efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Flow 'volume_create_manager' (29c35576-e60e-454f-92e8-aff2c98dc45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:43 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4a98b418-517b-4da2-b697-66c245149f29 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Created volume successfully. Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c" returned: 0 in 0.488s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.891s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1640932024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7c56c4-4775-49bd-89c1-ee2f03df177b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:37Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating volume da7c56c4-4775-49bd-89c1-ee2f03df177b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7644b0-4e29-4380-83ad-0b6fbef564ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b 1073741824 Nov 06 21:35:43 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91326cfa-fcc4-46b9-9a22-0e078b024de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c (08ac2c2b-2de4-4709-b2e4-dcd7b94d022c): created successfully Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91326cfa-fcc4-46b9-9a22-0e078b024de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (5fbd0c87-e8ab-465e-8eb2-d24ac9692f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e38dcfd-bc9a-4ca2-893e-1552e869b760 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created volume successfully. Nov 06 21:35:43 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7" returned: 0 in 0.532s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:43 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7 Nov 06 21:35:43 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Flow 'volume_create_manager' (51b5a54f-97f5-4cf0-be6f-b8f654e40f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9923de2d-1776-4596-8249-0a7d6ce76d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9923de2d-1776-4596-8249-0a7d6ce76d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921040ad-67cd-4a5a-a78f-d69650dd1575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d03a3e87224c03936b6c6642fd81ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:43Z,use_quota=True,user_id='80b7440a7c8d4838b45fad65be508a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b68a28-5dcb-4ce6-b6e3-2f5ba60f5657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b68a28-5dcb-4ce6-b6e3-2f5ba60f5657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cc4fa0-4394-4b9f-8b06-ba780ea8d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cc4fa0-4394-4b9f-8b06-ba780ea8d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921040ad-67cd-4a5a-a78f-d69650dd1575', 'volume_name': 'volume-921040ad-67cd-4a5a-a78f-d69650dd1575', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e284d99-47d9-43d1-bae1-66d23c23650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e284d99-47d9-43d1-bae1-66d23c23650c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100dce9d-6a9c-4121-9c90-162dc038643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Volume 921040ad-67cd-4a5a-a78f-d69650dd1575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921040ad-67cd-4a5a-a78f-d69650dd1575', 'volume_size': 1} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:43 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bdf6495d-a8f2-49ea-a973-0012dd5101e7" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-bdf6495d-a8f2-49ea-a973-0012dd5101e7" released by "delete_volume" :: held 0.893s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:43 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b 1073741824" returned: 0 in 0.556s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created reservations ['c6e4378b-7350-46c6-948a-af2ae36e7267', '93b2477d-284d-4d99-b89c-e6916f85545b', '8dd423b2-0f1f-41e6-8f54-3daed12311af', '254fcd9d-cb88-4bbd-b57b-c31b06c312a0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:43 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b Nov 06 21:35:43 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:43 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:43 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-665382af-19a5-41c7-aaf8-f7835b43dc2d-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-665382af-19a5-41c7-aaf8-f7835b43dc2d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:43 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b" returned: 0 in 0.275s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.409s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1505072767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af59bd3f-e86b-4b7b-bd34-6687306ea9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42443548ec1e4ae896f14f2e2da136e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:37Z,use_quota=True,user_id='e55f59876f07467d8c99198334c61148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Creating volume af59bd3f-e86b-4b7b-bd34-6687306ea9ed {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:43 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed 1073741824 Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-quobyte-665382af-19a5-41c7-aaf8-f7835b43dc2d" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:44 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1477855b-f8e4-4a4b-ba6a-7f93868a855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7c56c4-4775-49bd-89c1-ee2f03df177b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b0afce-44ea-45f5-b8c4-c2e27e6e2a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:44 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume volume-da7c56c4-4775-49bd-89c1-ee2f03df177b (da7c56c4-4775-49bd-89c1-ee2f03df177b): created successfully Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b0afce-44ea-45f5-b8c4-c2e27e6e2a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (493553d7-7eb2-470e-b7cf-26bee1c00ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-665382af-19a5-41c7-aaf8-f7835b43dc2d" acquired by "delete_volume" :: waited 0.061s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d6761a5d-a8d4-4fa7-9304-1330a3d0a281 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created volume successfully. Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fea96c-9066-483b-b456-d360038ef577]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Deleted volume successfully. Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58d191f4-f8fe-482f-88b6-09ead88d4acd tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-bdf6495d-a8f2-49ea-a973-0012dd5101e7-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Acquiring lock "cinder-08ac1c7b-f56d-4232-9530-db1ac490ca54-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "cinder-08ac1c7b-f56d-4232-9530-db1ac490ca54-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:44 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d Nov 06 21:35:44 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Acquiring lock "cinder-quobyte-08ac1c7b-f56d-4232-9530-db1ac490ca54" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "cinder-quobyte-08ac1c7b-f56d-4232-9530-db1ac490ca54" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc842cf-e7f2-4716-ab03-d23bd5425662]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed 1073741824" returned: 0 in 0.547s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 Nov 06 21:35:44 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed Nov 06 21:35:44 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d" returned: 0 in 0.505s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d Nov 06 21:35:44 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54" returned: 0 in 0.393s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:44 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54 Nov 06 21:35:44 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921040ad-67cd-4a5a-a78f-d69650dd1575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d03a3e87224c03936b6c6642fd81ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:43Z,use_quota=True,user_id='80b7440a7c8d4838b45fad65be508a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Creating volume 921040ad-67cd-4a5a-a78f-d69650dd1575 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:44 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a514c66-d759-44e5-b434-237f21f62339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:44 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 1073741824 Nov 06 21:35:44 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284dd2d0-70a8-42d7-9957-b35b62a6939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:44 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Volume volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed (af59bd3f-e86b-4b7b-bd34-6687306ea9ed): created successfully Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284dd2d0-70a8-42d7-9957-b35b62a6939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:44 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Flow 'volume_create_manager' (7a8fb12a-9ca6-4768-9b7f-a26fd12103c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-665382af-19a5-41c7-aaf8-f7835b43dc2d" returned: 0 in 0.306s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-665382af-19a5-41c7-aaf8-f7835b43dc2d" released by "delete_volume" :: held 0.892s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9a5caa03-2aeb-43c6-8834-9cdc956b0d4f tempest-CreateVolumesFromSnapshotTest-66592129 None] Created volume successfully. Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created reservations ['b4f363aa-6488-493c-baab-8dfcb9b82eea', 'fdf85992-e1c1-4240-a259-a157f728f185', '9647d99c-335d-474e-9e97-9be26ed36a0a', '3729144c-3d3f-44a4-8f7d-11f3272c62de'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:45 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac1c7b-f56d-4232-9530-db1ac490ca54" returned: 0 in 0.337s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "cinder-quobyte-08ac1c7b-f56d-4232-9530-db1ac490ca54" released by "delete_volume" :: held 0.780s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:45 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Created reservations ['2fedd13a-495f-4ecd-b43a-939d94b20e2c', 'c09f6dc3-6bbe-41c3-966d-4ca334d5b6d0', 'f2797992-c0c5-4631-a4a1-4f3b3055ea2d', '8a915d3e-97ae-46c4-b32c-c09e43ba8600'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:45 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:45 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:45 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.310s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-af59bd3f-e86b-4b7b-bd34-6687306ea9ed-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Deleted volume successfully. Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-af59bd3f-e86b-4b7b-bd34-6687306ea9ed-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:45 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-0ff88706-df5a-4792-b6bf-2f0faa93a29f tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-665382af-19a5-41c7-aaf8-f7835b43dc2d-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 1073741824" returned: 0 in 0.732s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-af59bd3f-e86b-4b7b-bd34-6687306ea9ed" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:45 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-af59bd3f-e86b-4b7b-bd34-6687306ea9ed" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.360s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Deleted volume successfully. Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f930c25-0cc5-4641-b59e-0eda13a13af5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:45 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 Nov 06 21:35:45 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5e8db4fc-2c65-4027-b923-5a55ec61bc37 tempest-VolumeAndVolumeTypeFromImageTest-2029375059 None] Lock "cinder-08ac1c7b-f56d-4232-9530-db1ac490ca54-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:45 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed Nov 06 21:35:45 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:45 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100dce9d-6a9c-4121-9c90-162dc038643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921040ad-67cd-4a5a-a78f-d69650dd1575', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:45 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce478de-37a7-406a-8632-f6cb32595c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:46 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Volume volume-921040ad-67cd-4a5a-a78f-d69650dd1575 (921040ad-67cd-4a5a-a78f-d69650dd1575): created successfully Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce478de-37a7-406a-8632-f6cb32595c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Flow 'volume_create_manager' (51b5a54f-97f5-4cf0-be6f-b8f654e40f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b9523114-bc65-4059-874c-07d9202be533 tempest-CinderUnicodeTest-128228898 None] Created volume successfully. Nov 06 21:35:46 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed" returned: 0 in 0.464s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-51255020-a05a-4aa5-a681-d70206209705-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:46 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed Nov 06 21:35:46 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-51255020-a05a-4aa5-a681-d70206209705-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-quobyte-51255020-a05a-4aa5-a681-d70206209705" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-51255020-a05a-4aa5-a681-d70206209705" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e20a2-ea01-4965-97de-2f4cfdcee1a4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:46 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 Nov 06 21:35:46 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:46 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-af59bd3f-e86b-4b7b-bd34-6687306ea9ed" returned: 0 in 0.310s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-af59bd3f-e86b-4b7b-bd34-6687306ea9ed" released by "delete_volume" :: held 0.843s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['11c3a2cc-6d52-4ba4-b026-fd7e444211e3', 'ca475e6a-4d59-4a56-9273-8a71d0306cd3', '38d96f5f-2266-4f9d-808c-bb3cb6e4e874', '6a1c6d57-02d1-4906-9f56-13b7149b8526'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:46 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705" returned: 0 in 0.466s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:46 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:46 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-da7c56c4-4775-49bd-89c1-ee2f03df177b-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:46 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705 Nov 06 21:35:46 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-da7c56c4-4775-49bd-89c1-ee2f03df177b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-da7c56c4-4775-49bd-89c1-ee2f03df177b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-da7c56c4-4775-49bd-89c1-ee2f03df177b" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[22071654-11aa-4f97-a8ab-3a5251cb8dca]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:47 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b Nov 06 21:35:47 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:47 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-51255020-a05a-4aa5-a681-d70206209705" returned: 0 in 0.419s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:47 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.496s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-51255020-a05a-4aa5-a681-d70206209705" released by "delete_volume" :: held 0.961s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleted volume successfully. Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-42afe688-e3b5-4dc5-913e-579007a356fb tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-af59bd3f-e86b-4b7b-bd34-6687306ea9ed-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created reservations ['142ab679-f1fc-4791-a3f4-458745913832', '71aa60aa-d3bf-4956-82db-49aad9035afe', 'ae54de13-6566-42aa-b791-bb251056982b', '47a0be0e-6e2e-46c5-a5ed-f545da9a4c2d'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:47 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:47 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:47 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Flow 'volume_create_manager' (103a088d-0989-40b0-a238-3639cae9dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5e5238-fbff-4b15-9a95-81be5caa39ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b" returned: 0 in 0.587s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5e5238-fbff-4b15-9a95-81be5caa39ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1810449138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dda08d-61be-4232-849e-425505f16e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d03a3e87224c03936b6c6642fd81ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:47Z,use_quota=True,user_id='80b7440a7c8d4838b45fad65be508a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:47 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b Nov 06 21:35:47 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3f89fe-0784-45d6-86da-cbc00b720691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3f89fe-0784-45d6-86da-cbc00b720691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed7d85f-fe7e-4c55-92ee-e3f821f0b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed7d85f-fe7e-4c55-92ee-e3f821f0b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32dda08d-61be-4232-849e-425505f16e08', 'volume_name': 'volume-32dda08d-61be-4232-849e-425505f16e08', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51aadc08-8d4f-4048-aac6-3dc68447a347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51aadc08-8d4f-4048-aac6-3dc68447a347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2457042-1fdc-4edf-b0ce-e85b3d47b409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Volume 32dda08d-61be-4232-849e-425505f16e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32dda08d-61be-4232-849e-425505f16e08', 'volume_size': 1} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1810449138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dda08d-61be-4232-849e-425505f16e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d03a3e87224c03936b6c6642fd81ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:47Z,use_quota=True,user_id='80b7440a7c8d4838b45fad65be508a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Creating volume 32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:47 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:47 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 1073741824 Nov 06 21:35:47 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:47 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.312s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Deleted volume successfully. Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e464df29-a79d-4cb3-a882-e361108752af tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-51255020-a05a-4aa5-a681-d70206209705-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:47 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-da7c56c4-4775-49bd-89c1-ee2f03df177b" returned: 0 in 0.347s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-da7c56c4-4775-49bd-89c1-ee2f03df177b" released by "delete_volume" :: held 1.006s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['cdef1ef7-e4d5-49f8-a370-83abe7f10f63', 'abe1abf4-7fbd-4429-b926-5d57a8bae142', 'fe5f78a1-eb0d-4ccc-81e1-169462fe49a5', 'b2a8d5c1-0322-4295-a90d-7bea1670ab32'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:48 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:48 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:48 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 1073741824" returned: 0 in 0.576s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:48 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 Nov 06 21:35:48 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:48 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleted volume successfully. Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-410d6b2c-5457-43ca-97d2-5f27a409cf5d tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-da7c56c4-4775-49bd-89c1-ee2f03df177b-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-688e5222-e63b-4d39-bd37-da62857fb1f9-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-688e5222-e63b-4d39-bd37-da62857fb1f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "cinder-quobyte-688e5222-e63b-4d39-bd37-da62857fb1f9" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-688e5222-e63b-4d39-bd37-da62857fb1f9" acquired by "delete_volume" :: waited 0.036s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5d5e64-1faf-4926-9c0f-96e00e3fc939]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:48 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08" returned: 0 in 0.363s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2457042-1fdc-4edf-b0ce-e85b3d47b409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32dda08d-61be-4232-849e-425505f16e08', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a66079-5f34-4acf-958e-9964b5ecb0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:48 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Volume volume-32dda08d-61be-4232-849e-425505f16e08 (32dda08d-61be-4232-849e-425505f16e08): created successfully Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a66079-5f34-4acf-958e-9964b5ecb0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:48 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Flow 'volume_create_manager' (103a088d-0989-40b0-a238-3639cae9dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-65e8f631-1536-4a65-a20f-6b3b3e42ad34 tempest-CinderUnicodeTest-128228898 None] Created volume successfully. Nov 06 21:35:48 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 Nov 06 21:35:48 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9" returned: 0 in 0.391s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:49 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9 Nov 06 21:35:49 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e445269-2d16-414e-bcd1-5722076d714c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:49 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-688e5222-e63b-4d39-bd37-da62857fb1f9" returned: 0 in 0.301s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-quobyte-688e5222-e63b-4d39-bd37-da62857fb1f9" released by "delete_volume" :: held 0.747s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:49 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c Nov 06 21:35:49 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Created reservations ['df730974-2438-4dec-bb18-f98e758c4457', '07f8b176-492c-4e2b-9207-fccd0521ab42', '823001fc-5812-4fb1-b179-46d0a81269e0', 'f3df1783-0a77-47a1-a06c-ae360877382a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:49 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:49 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c" returned: 0 in 0.549s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:49 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.379s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Deleted volume successfully. Nov 06 21:35:49 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c Nov 06 21:35:49 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-68bf45ba-266f-4eb7-a8f5-0f5ad8d609e2 tempest-CreateVolumesFromSourceVolumeTest-1848415137 None] Lock "cinder-688e5222-e63b-4d39-bd37-da62857fb1f9-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Creating offline snapshot 6ce997c6-3a5d-4cfb-85dc-46225f0197bc of volume 32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2690fbc-a106-4a29-8804-c65a7475b37f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:50 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 Nov 06 21:35:50 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:50 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c" returned: 0 in 0.467s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c" released by "delete_volume" :: held 1.089s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['9e7bf041-d163-43f7-a0c0-7109d36b7c2a', 'f67b9a6f-783f-457c-bace-c4ab782db51b', '46aa10c5-ade7-4920-b538-dc573f35a98f', '9d6cad9c-3959-46c0-b381-a3e9f58f5bdb'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:50 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:50 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:50 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08" returned: 0 in 0.606s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:50 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc 1G Nov 06 21:35:50 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:50 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.387s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:50 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleted volume successfully. Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7a486fb8-cb5f-42fd-ab93-bbb37489de22 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-08ac2c2b-2de4-4709-b2e4-dcd7b94d022c-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:51 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc 1G" returned: 0 in 0.524s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32dda08d-61be-4232-849e-425505f16e08 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:51 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32dda08d-61be-4232-849e-425505f16e08 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc Nov 06 21:35:51 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-973f1252-9f99-4e65-9887-9d2822f45d2e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-973f1252-9f99-4e65-9887-9d2822f45d2e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-973f1252-9f99-4e65-9887-9d2822f45d2e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-973f1252-9f99-4e65-9887-9d2822f45d2e" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:51 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32dda08d-61be-4232-849e-425505f16e08 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc" returned: 0 in 0.407s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:51 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc is being set with open permissions: ugo+rw Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca5a37-f322-4bed-8a51-f79090e161dc]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:51 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc Nov 06 21:35:51 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:51 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e Nov 06 21:35:51 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Flow 'volume_create_manager' (3acab2cf-36e3-4573-a190-785501e45ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0e9bce-1d86-4af2-a11d-2b95d4d96db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:51 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc" returned: 0 in 0.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:51 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0e9bce-1d86-4af2-a11d-2b95d4d96db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2096708966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e2eeb6-5789-466e-8be6-fa9f9fb88487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a350691ebb944edab652f1b4e0790e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:52Z,use_quota=True,user_id='303d0e45869a433c8f742ea1897f9253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20cef8-84cf-436c-ad63-730a2a85d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20cef8-84cf-436c-ad63-730a2a85d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa014033-5c75-414d-af2b-1c69671ab75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa014033-5c75-414d-af2b-1c69671ab75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e2eeb6-5789-466e-8be6-fa9f9fb88487', 'volume_name': 'volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0388737-1a0c-49e1-ab4a-ebfd2c2ddf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0388737-1a0c-49e1-ab4a-ebfd2c2ddf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778902b6-d1ab-4808-a5eb-9d99b62794dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Volume a1e2eeb6-5789-466e-8be6-fa9f9fb88487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487', 'volume_size': 1} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info Nov 06 21:35:52 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e" returned: 0 in 0.469s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e Nov 06 21:35:52 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info" returned: 0 in 0.280s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:52 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info is being set with open permissions: ugo+rw Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-973f1252-9f99-4e65-9887-9d2822f45d2e" returned: 0 in 0.264s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:52 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info Nov 06 21:35:52 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-973f1252-9f99-4e65-9887-9d2822f45d2e" released by "delete_volume" :: held 0.796s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['94acac49-fde3-43c4-9aad-1d1146a5ee28', 'f0f37de9-b41b-412e-8d77-287063ef9b2b', 'f47b9c1f-1674-4d0f-8149-c785f022580e', '3b2a2b51-ea75-4b52-9bab-92eaa1151354'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:52 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.info" returned: 0 in 0.288s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2096708966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e2eeb6-5789-466e-8be6-fa9f9fb88487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a350691ebb944edab652f1b4e0790e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:52Z,use_quota=True,user_id='303d0e45869a433c8f742ea1897f9253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Creating volume a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:52 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-2d988e2e-85f9-4336-b654-0c5451fd3d53-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:52 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 1073741824 Nov 06 21:35:52 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3d335328-1ef8-41fe-83d7-6c832a34a913 tempest-CinderUnicodeTest-128228898 None] Create snapshot completed successfully Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-2d988e2e-85f9-4336-b654-0c5451fd3d53-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-2d988e2e-85f9-4336-b654-0c5451fd3d53" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-2d988e2e-85f9-4336-b654-0c5451fd3d53" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:52 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.372s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1c00a-d807-4b5a-8b3a-3bf7d7dc887d]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleted volume successfully. Nov 06 21:35:52 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-5de072ed-a8c5-4974-a1ef-f231968844a3 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-973f1252-9f99-4e65-9887-9d2822f45d2e-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:53 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 Nov 06 21:35:53 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-6ce997c6-3a5d-4cfb-85dc-46225f0197bc-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Lock "cinder-6ce997c6-3a5d-4cfb-85dc-46225f0197bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-quobyte-32dda08d-61be-4232-849e-425505f16e08" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-32dda08d-61be-4232-849e-425505f16e08" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-quobyte-6ce997c6-3a5d-4cfb-85dc-46225f0197bc" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-6ce997c6-3a5d-4cfb-85dc-46225f0197bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Deleting offline snapshot 6ce997c6-3a5d-4cfb-85dc-46225f0197bc of volume 32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] snapshot_file for this snap is: volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d77d671-6330-46e2-8c84-343b77f427f1]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 1073741824" returned: 0 in 0.675s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 Nov 06 21:35:53 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:53 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc Nov 06 21:35:53 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53" returned: 0 in 0.552s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53 Nov 06 21:35:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:53 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" returned: 0 in 0.296s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778902b6-d1ab-4808-a5eb-9d99b62794dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f268d922-b3ab-4790-b18b-cc3bd24a993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:53 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2d988e2e-85f9-4336-b654-0c5451fd3d53" returned: 0 in 0.297s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Volume volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 (a1e2eeb6-5789-466e-8be6-fa9f9fb88487): created successfully Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f268d922-b3ab-4790-b18b-cc3bd24a993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Flow 'volume_create_manager' (3acab2cf-36e3-4573-a190-785501e45ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-2d988e2e-85f9-4336-b654-0c5451fd3d53" released by "delete_volume" :: held 0.955s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32dda08d-61be-4232-849e-425505f16e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:53 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-23d5fc89-92f3-45b1-b30a-6e274fb572d5 tempest-VolumeDependencyTests-1251730437 None] Created volume successfully. Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0e1c61-6fe4-4413-b16a-54c6e4c62d32]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['2aa289a5-5cf4-45e4-ac50-e837af363d5d', '2ecc5016-6835-4c51-8ec0-b0e553050ca8', '172314cf-1581-4d71-a254-7b46ac17f3d4', 'a61c1d04-5b7e-4392-a636-605f1ae40bc2'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 Nov 06 21:35:54 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:54 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:54 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Creating offline snapshot b8913a17-1ced-4277-acf9-4686af6825ea of volume a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.364s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08" returned: 0 in 0.496s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleted volume successfully. Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47ec09-9ad3-47b0-85b1-ecba31cd2437]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc Nov 06 21:35:54 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-26e40b9c-bfcc-4226-a58a-1152a02418fd tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-2d988e2e-85f9-4336-b654-0c5451fd3d53-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:54 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 Nov 06 21:35:54 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc Nov 06 21:35:54 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" returned: 0 in 0.420s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:54 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea 1G Nov 06 21:35:54 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-bfb563b6-8307-4098-bce4-62597b22693d-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-bfb563b6-8307-4098-bce4-62597b22693d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-2209de25-c647-452a-af68-188df9f8691d" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-2209de25-c647-452a-af68-188df9f8691d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-bfb563b6-8307-4098-bce4-62597b22693d" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-bfb563b6-8307-4098-bce4-62597b22693d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleting offline snapshot bfb563b6-8307-4098-bce4-62597b22693d of volume 2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:35:55 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] snapshot_file for this snap is: volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08.6ce997c6-3a5d-4cfb-85dc-46225f0197bc" returned: 0 in 0.352s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a263f7f5-9ad5-4a39-84be-82cd4feb053c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-6ce997c6-3a5d-4cfb-85dc-46225f0197bc" released by "_delete_snapshot" :: held 1.849s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-32dda08d-61be-4232-849e-425505f16e08" released by "delete_snapshot" :: held 1.875s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:55 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d Nov 06 21:35:55 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Created reservations ['0c30dfa2-b33e-441a-bfa1-b863ac184ac8', '7efb7c23-a794-46ee-9e22-71168daeb455', '7677a745-061d-4540-a455-12dd7a0f77c4', '4cf818cc-cf94-4255-990a-7d49861b46e4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Delete snapshot completed successfully. Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f7b8054-3b49-4c22-a640-5637141fc3bd tempest-CinderUnicodeTest-128228898 None] Lock "cinder-6ce997c6-3a5d-4cfb-85dc-46225f0197bc-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:55 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea 1G" returned: 0 in 0.531s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea Nov 06 21:35:55 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-32dda08d-61be-4232-849e-425505f16e08-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-32dda08d-61be-4232-849e-425505f16e08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-quobyte-32dda08d-61be-4232-849e-425505f16e08" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-32dda08d-61be-4232-849e-425505f16e08" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:55 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d" returned: 0 in 0.514s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2209de25-c647-452a-af68-188df9f8691d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bb1938-6ae1-4842-bf44-45430fd1b7fb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[086eb923-d932-4587-9249-b6ebf92a04fb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea" returned: 0 in 0.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:55 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea is being set with open permissions: ugo+rw Nov 06 21:35:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:55 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea Nov 06 21:35:55 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:55 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 Nov 06 21:35:55 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:55 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d Nov 06 21:35:55 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea" returned: 0 in 0.301s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info Nov 06 21:35:56 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08" returned: 0 in 0.467s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d" returned: 0 in 0.462s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08 Nov 06 21:35:56 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d Nov 06 21:35:56 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info" returned: 0 in 0.313s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info is being set with open permissions: ugo+rw Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info Nov 06 21:35:56 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-32dda08d-61be-4232-849e-425505f16e08" returned: 0 in 0.353s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-32dda08d-61be-4232-849e-425505f16e08" released by "delete_volume" :: held 0.916s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:56 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d" returned: 0 in 0.479s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Created reservations ['830c5172-9628-410c-98db-f9080660ba3c', 'bf526421-619e-437f-868d-0b102c2a5e0b', '0845f676-0d47-4d50-803d-0ddddfca910f', 'aa59728e-dd6c-449b-9a70-0f4696e8ca5e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:56 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d Nov 06 21:35:56 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.info" returned: 0 in 0.311s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7592ab33-f194-42d9-855a-0c2a27b9911c tempest-VolumeDependencyTests-1251730437 None] Create snapshot completed successfully Nov 06 21:35:56 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:56 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:56 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d.bfb563b6-8307-4098-bce4-62597b22693d" returned: 0 in 0.304s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-bfb563b6-8307-4098-bce4-62597b22693d" released by "_delete_snapshot" :: held 1.949s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-2209de25-c647-452a-af68-188df9f8691d" released by "delete_snapshot" :: held 1.982s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:57 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.300s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Deleted volume successfully. Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['9f221926-5815-4ac2-8bc3-bb6b4b66300e', '3e37e17c-8dbd-437e-aeff-4d1f6ab26a09', 'cec6f067-5a95-4c69-9d0a-2cfc744a24da', '5910bae7-b1a8-45be-9d35-4d86a1a61852'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2b26c737-bd84-414c-98c7-03a13d5ae337 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-32dda08d-61be-4232-849e-425505f16e08-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Delete snapshot completed successfully. Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-18969151-d9a5-4db1-96b2-1a70e7536000 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-bfb563b6-8307-4098-bce4-62597b22693d-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Flow 'volume_create_manager' (293773ce-47bf-4b04-8c01-c9daf9ab1f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83655979-239d-4e1e-b375-59c5d4491bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83655979-239d-4e1e-b375-59c5d4491bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1622805bf30c492d8c09710fcc474783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:57Z,use_quota=True,user_id='9807801d27c14c71bb23b6645cfafe95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb3b97e-5222-46f3-8fa5-ee462596effc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb3b97e-5222-46f3-8fa5-ee462596effc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59dad22-93ec-462c-a061-13cb59c8e36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.image.glance [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Creating Keystone auth plugin from conf {{(pid=87350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59dad22-93ec-462c-a061-13cb59c8e36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed', 'volume_name': 'volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed', 'volume_size': 1, 'image_id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea8522c250206556d07bd92bf3609aac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1622805bf30c492d8c09710fcc474783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ca8aeae6a12c59da92e2cffaf40a5040761d34ec00c0452bdc972716f624f0bfbc11b5906f55d676d6f9ceebddf1c2f527de9f0145c6c5ed86470c01767f39d', 'id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1/file', 'properties': {}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3651d670-aa65-4926-96a0-9fcc9603ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3651d670-aa65-4926-96a0-9fcc9603ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3a52d5-4a13-41bf-8cf2-a3b1c4be240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:57 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Volume 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed', 'volume_size': 1, 'image_id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea8522c250206556d07bd92bf3609aac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1622805bf30c492d8c09710fcc474783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ca8aeae6a12c59da92e2cffaf40a5040761d34ec00c0452bdc972716f624f0bfbc11b5906f55d676d6f9ceebddf1c2f527de9f0145c6c5ed86470c01767f39d', 'id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1/file', 'properties': {}}, 'image_service': } Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Trying to clone 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed from image d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'metadata': {}}]). {{(pid=87350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1098}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:35:57 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e83bd-2079-4ed3-ac8a-ac04570c5268]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-921040ad-67cd-4a5a-a78f-d69650dd1575-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:57 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD Nov 06 21:35:57 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-921040ad-67cd-4a5a-a78f-d69650dd1575-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "cinder-quobyte-921040ad-67cd-4a5a-a78f-d69650dd1575" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-921040ad-67cd-4a5a-a78f-d69650dd1575" acquired by "delete_volume" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678570b-3fed-49a5-a980-c1995eb5c01c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 Nov 06 21:35:58 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:35:58 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD Nov 06 21:35:58 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Flow 'volume_create_manager' (3a08e799-fbe4-4a77-9834-cb4b40aee0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63bd26b-bdae-4692-b833-5ce13102a456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-2209de25-c647-452a-af68-188df9f8691d-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63bd26b-bdae-4692-b833-5ce13102a456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1717364758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b58e6dd-54e1-47cf-9c0d-282ba91790a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a350691ebb944edab652f1b4e0790e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8913a17-1ced-4277-acf9-4686af6825ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:58Z,use_quota=True,user_id='303d0e45869a433c8f742ea1897f9253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecd1cfc-0913-4640-ab27-1f23fa08214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecd1cfc-0913-4640-ab27-1f23fa08214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e6a227-eef8-4406-87ba-242b50cda894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e6a227-eef8-4406-87ba-242b50cda894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b58e6dd-54e1-47cf-9c0d-282ba91790a7', 'volume_name': 'volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7', 'volume_size': 1, 'snapshot_id': 'b8913a17-1ced-4277-acf9-4686af6825ea'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14b48cf-77d2-4c73-a022-49b15ee127d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14b48cf-77d2-4c73-a022-49b15ee127d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a5251c-be32-4008-9f64-83e4ef6017ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:35:58 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Volume 2b58e6dd-54e1-47cf-9c0d-282ba91790a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7', 'volume_size': 1, 'snapshot_id': 'b8913a17-1ced-4277-acf9-4686af6825ea'} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-quobyte-b8913a17-1ced-4277-acf9-4686af6825ea-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-2209de25-c647-452a-af68-188df9f8691d-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-b8913a17-1ced-4277-acf9-4686af6825ea-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Creating volume 2b58e6dd-54e1-47cf-9c0d-282ba91790a7 from snapshot b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-quobyte-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "cinder-quobyte-2209de25-c647-452a-af68-188df9f8691d" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] snapshot: b8913a17-1ced-4277-acf9-4686af6825ea, volume: 2b58e6dd-54e1-47cf-9c0d-282ba91790a7, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:35:58 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575" returned: 0 in 0.483s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-2209de25-c647-452a-af68-188df9f8691d" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:35:58 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575 Nov 06 21:35:58 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f33f0e-66e8-48da-92b8-000594a4473e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc34812-258f-44d8-bf0e-2f5671cded5b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD" returned: 1 in 0.477s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Temporary image d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 is fetched for user 9807801d27c14c71bb23b6645cfafe95. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f565d3-8ca2-4bdd-8b68-c60c809b1efe]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d Nov 06 21:35:58 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea Nov 06 21:35:58 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-921040ad-67cd-4a5a-a78f-d69650dd1575" returned: 0 in 0.286s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-quobyte-921040ad-67cd-4a5a-a78f-d69650dd1575" released by "delete_volume" :: held 0.825s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:58 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD Nov 06 21:35:58 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Created reservations ['8fb0fc27-b4f4-458c-b221-e19318880520', 'b346c46d-8138-4d6b-81dc-df239525d403', 'cba3bfb1-fb9e-4f03-aab5-f3b137d635d4', 'cb3becb1-e189-44db-9c72-eeb63435833f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:58 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:58 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea" returned: 0 in 0.439s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:35:58 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d Nov 06 21:35:58 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c4082a-6894-4438-82d3-6956ab367d87]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:35:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 Nov 06 21:35:59 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.303s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Deleted volume successfully. Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD" returned: 0 in 0.623s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-feb0e1af-a5fc-4cdf-a612-4723e78a7178 tempest-CinderUnicodeTest-128228898 None] Lock "cinder-921040ad-67cd-4a5a-a78f-d69650dd1575-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:59 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD Nov 06 21:35:59 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2209de25-c647-452a-af68-188df9f8691d" returned: 0 in 0.515s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" returned: 0 in 0.492s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-quobyte-2209de25-c647-452a-af68-188df9f8691d" released by "delete_volume" :: held 1.063s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:35:59 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 Nov 06 21:35:59 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Created reservations ['0d0d5daa-eb19-4187-a353-7356b88820a5', '967efdde-4714-4ae2-99a9-5723748bc208', '03c68ec4-45a7-4310-8bb0-977b9488b990', '5adb6088-03ed-474b-b577-6731f15b4e67'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:59 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:35:59 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:59 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD" returned: 1 in 0.427s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:35:59 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.284s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:35:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Deleted volume successfully. Nov 06 21:35:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-491f638e-2ded-415d-babf-7d90c7e15930 tempest-CreateVolumesFromSnapshotTest-66592129 None] Lock "cinder-2209de25-c647-452a-af68-188df9f8691d-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:07 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" returned: 0 in 7.933s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:36:07 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Converted 1024.00 MB image at 129.06 MB/s Nov 06 21:36:07 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 is being set with open permissions: ugo+rw Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 Nov 06 21:36:07 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" released by "_copy_volume_from_snapshot" :: held 9.308s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-b8913a17-1ced-4277-acf9-4686af6825ea-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" released by "_create_volume_from_snapshot" :: held 9.402s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.421s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.111s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1622805bf30c492d8c09710fcc474783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:35:57Z,use_quota=True,user_id='9807801d27c14c71bb23b6645cfafe95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Creating volume 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:07 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:07 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed 1073741824 Nov 06 21:36:07 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a5251c-be32-4008-9f64-83e4ef6017ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7', 'volume_size': 1, 'snapshot_id': 'b8913a17-1ced-4277-acf9-4686af6825ea'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b438f0cd-e0ba-4251-b787-c7cbde9bd7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:07 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Volume volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 (2b58e6dd-54e1-47cf-9c0d-282ba91790a7): created successfully Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b438f0cd-e0ba-4251-b787-c7cbde9bd7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Flow 'volume_create_manager' (3a08e799-fbe4-4a77-9834-cb4b40aee0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:07 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-38b98262-486d-4567-8ae1-0b15ff08a61d tempest-VolumeDependencyTests-1251730437 None] Created volume successfully. Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-b8913a17-1ced-4277-acf9-4686af6825ea-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-b8913a17-1ced-4277-acf9-4686af6825ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-quobyte-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-quobyte-b8913a17-1ced-4277-acf9-4686af6825ea" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-b8913a17-1ced-4277-acf9-4686af6825ea" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Deleting offline snapshot b8913a17-1ced-4277-acf9-4686af6825ea of volume a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] snapshot_file for this snap is: volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:08 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2364a80e-3fd3-4c7a-b7df-945fc0cc06da]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed 1073741824" returned: 0 in 0.664s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed Nov 06 21:36:08 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea Nov 06 21:36:08 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:08 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" returned: 0 in 0.309s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Attempting download of d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'metadata': {}}])) to volume 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Nov 06 21:36:08 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea" returned: 0 in 0.493s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff595c-cba0-40e0-8510-0813ea737ceb]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4cfb61-529b-41d0-9743-c4f30ee914d6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:08 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6 Nov 06 21:36:09 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 Nov 06 21:36:09 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6" returned: 0 in 0.465s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6 Nov 06 21:36:09 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" returned: 0 in 0.722s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea Nov 06 21:36:09 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:09 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6" returned: 1 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_4do9i0y6' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a2a840-40ef-4d5a-94b9-3cef697af6f1]: (4, 'raw') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:09 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD Nov 06 21:36:09 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea" returned: 0 in 0.399s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea Nov 06 21:36:10 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD Nov 06 21:36:10 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:10 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487.b8913a17-1ced-4277-acf9-4686af6825ea" returned: 0 in 0.330s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-b8913a17-1ced-4277-acf9-4686af6825ea" released by "_delete_snapshot" :: held 2.131s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" released by "delete_snapshot" :: held 2.161s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Created reservations ['981cff57-db14-42b3-ae98-2d639ed8b7f2', '055aa720-a621-44e0-9258-a2136c44d925', 'fa918c74-ad77-40f6-9282-f772b6cde165', 'aabf91ac-07ba-4ecf-ac17-bf14dd7f72fc'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:10 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Delete snapshot completed successfully. Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a9d1e710-8443-4bd5-afce-f23713fcddf5 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-b8913a17-1ced-4277-acf9-4686af6825ea-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:10 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD" returned: 1 in 0.451s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 was raw, converting to qcow2 {{(pid=87350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:36:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:10 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed Nov 06 21:36:10 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:11 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" returned: 0 in 0.599s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1_w3drakm6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:36:11 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:11 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed 1G Nov 06 21:36:11 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-a1e2eeb6-5789-466e-8be6-fa9f9fb88487-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:11 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed 1G" returned: 0 in 0.408s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Downloaded image d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'metadata': {}}])) to volume 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed successfully. {{(pid=87350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Temporary image d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 for user 9807801d27c14c71bb23b6645cfafe95 is deleted. {{(pid=87350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.volume_utils [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Marking volume 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed as bootable. {{(pid=87350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-a1e2eeb6-5789-466e-8be6-fa9f9fb88487-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Copying metadata from image d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 to 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed. {{(pid=87350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:453}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Creating volume glance metadata for volume 2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed backed by image d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1 with: {'image_id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ea8522c250206556d07bd92bf3609aac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:689}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-quobyte-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" acquired by "delete_volume" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88ad61b-30b5-4c3d-9969-955af3ffc6e1]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3a52d5-4a13-41bf-8cf2-a3b1c4be240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed', 'volume_size': 1, 'image_id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea8522c250206556d07bd92bf3609aac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1622805bf30c492d8c09710fcc474783', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ca8aeae6a12c59da92e2cffaf40a5040761d34ec00c0452bdc972716f624f0bfbc11b5906f55d676d6f9ceebddf1c2f527de9f0145c6c5ed86470c01767f39d', 'id': 'd09d0c1d-310a-45c1-bbc7-ea7411ae2bc1', 'created_at': datetime.datetime(2026, 11, 6, 20, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 35, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d09d0c1d-310a-45c1-bbc7-ea7411ae2bc1/file', 'properties': {}}, 'image_service': }' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc7a5aa-1a9b-4a87-9774-8d224f26f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:11 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Volume volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed (2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed): created successfully Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc7a5aa-1a9b-4a87-9774-8d224f26f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Flow 'volume_create_manager' (293773ce-47bf-4b04-8c01-c9daf9ab1f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f3f4ebb8-c2a8-44e2-af50-6b1fb1eea63e tempest-VolumeImageDependencyTests-1555499707 None] Created volume successfully. Nov 06 21:36:12 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 Nov 06 21:36:12 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:12 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" returned: 0 in 0.446s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:12 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487 Nov 06 21:36:12 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:12 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-a1e2eeb6-5789-466e-8be6-fa9f9fb88487" released by "delete_volume" :: held 0.835s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Created reservations ['a5898f57-cae5-4a19-8f1b-4858d8e7db14', '8025d91c-98cd-4419-aadd-b8910562c6ff', 'b93fc86a-33ab-4055-aaa5-3e2d53203d83', 'e41a99ee-434f-4ba2-8614-6012831bbc37'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:12 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:12 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:13 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-2b58e6dd-54e1-47cf-9c0d-282ba91790a7-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.344s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:13 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Deleted volume successfully. Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-2b58e6dd-54e1-47cf-9c0d-282ba91790a7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-22f1b8bc-e03f-4da8-9137-90ddc8a5f567 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-a1e2eeb6-5789-466e-8be6-fa9f9fb88487-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Acquiring lock "cinder-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "cinder-quobyte-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Lock "cinder-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" acquired by "delete_volume" :: waited 0.052s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d482d58a-2b0f-4acb-bff0-d250162b05a3]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Acquiring lock "cinder-quobyte-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Lock "cinder-quobyte-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abffeb9-640c-47a4-8f47-fafd31d98dd7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:13 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 Nov 06 21:36:13 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:13 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed Nov 06 21:36:13 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:13 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" returned: 0 in 0.452s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:13 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7 Nov 06 21:36:13 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:13 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" returned: 0 in 0.439s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:13 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed Nov 06 21:36:13 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:14 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" returned: 0 in 0.282s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-quobyte-2b58e6dd-54e1-47cf-9c0d-282ba91790a7" released by "delete_volume" :: held 0.797s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:14 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" returned: 0 in 0.267s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Lock "cinder-quobyte-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed" released by "delete_volume" :: held 0.756s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Created reservations ['b1ada4af-1752-40a8-9870-9a2b7caa1d77', '5548556b-4c91-4edd-a5c2-0fd981da46fa', '19f78aa9-72b1-44ac-bc9e-8bc02f31e1d7', '1074ce66-71bf-40de-87a2-ed4e14987762'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Created reservations ['95f45a1e-ef51-4e18-89af-ed1e6b479ab2', '55ab9885-8949-4575-a0bf-1646f4f8e33b', 'c6a01972-39f1-4c44-910e-8641699ce8bd', 'b03d3a7b-a669-41de-b6c4-78d2dad94802'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:14 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:14 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:14 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:14 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:14 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.566s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:14 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.486s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:14 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Deleted volume successfully. Nov 06 21:36:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Deleted volume successfully. Nov 06 21:36:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ce4cf456-34b1-4940-a4c9-033ec9f7a954 tempest-VolumeDependencyTests-1251730437 None] Lock "cinder-2b58e6dd-54e1-47cf-9c0d-282ba91790a7-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b2f02f4c-a684-4ec0-9064-25431a9559b8 tempest-VolumeImageDependencyTests-1555499707 None] Lock "cinder-2b4ec6eb-4820-4f52-9fa4-7a1c1a8eaeed-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:19 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-91863b4e-dc81-4e13-a5b3-ec00bbc917d8 tempest-ProjectAdminTests-1314414215 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7974166870117, 'free_capacity_gb': 1773.7974166870117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4903}} Nov 06 21:36:22 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=194,cinder:INSERT=75,cinder:UPDATE=272,cinder:DELETE=27 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:36:22 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=209,cinder:UPDATE=283,cinder:INSERT=74,cinder:DELETE=22 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (94fe9856-a015-41af-9a95-f730916e4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e6303c-49f1-46e9-a7b9-55330162c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e6303c-49f1-46e9-a7b9-55330162c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934164622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e272c6-07ef-41ef-9eec-6ec62f6abaa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:26Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892a8535-ba7e-460f-8743-a879969e86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892a8535-ba7e-460f-8743-a879969e86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70c706c-a76e-461c-a6d7-b41603a74c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70c706c-a76e-461c-a6d7-b41603a74c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e272c6-07ef-41ef-9eec-6ec62f6abaa8', 'volume_name': 'volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8c9092-604d-409e-b738-9828edd40927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8c9092-604d-409e-b738-9828edd40927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45e190a-e48b-4171-8129-87d71dd5e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Volume 33e272c6-07ef-41ef-9eec-6ec62f6abaa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8', 'volume_size': 1} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934164622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e272c6-07ef-41ef-9eec-6ec62f6abaa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:26Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Creating volume 33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 1073741824 Nov 06 21:36:26 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:26 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 1073741824" returned: 0 in 0.503s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:26 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 Nov 06 21:36:26 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:27 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" returned: 0 in 0.269s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45e190a-e48b-4171-8129-87d71dd5e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c64c4b7-566c-473e-bdf5-b4672ac1b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Volume volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 (33e272c6-07ef-41ef-9eec-6ec62f6abaa8): created successfully Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c64c4b7-566c-473e-bdf5-b4672ac1b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (94fe9856-a015-41af-9a95-f730916e4209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8064b0a8-ecc0-46c7-82d7-bbb40aad2e50 tempest-ProjectReaderTests-1159230339 None] Created volume successfully. Nov 06 21:36:27 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (87542940-b2d8-46f1-807c-2c94013c421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f9a66d-cde8-4bda-bb32-2ca68a2937e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f9a66d-cde8-4bda-bb32-2ca68a2937e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107527873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8d3384-0cf8-479b-b695-5d536c9953c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:28Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7915cf6f-fcd0-4aff-97b7-3e13af5f9adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7915cf6f-fcd0-4aff-97b7-3e13af5f9adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05906a9f-29d3-404e-ae7f-d4048567b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05906a9f-29d3-404e-ae7f-d4048567b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8d3384-0cf8-479b-b695-5d536c9953c1', 'volume_name': 'volume-6e8d3384-0cf8-479b-b695-5d536c9953c1', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a3bed7-12f6-4c32-86fd-35924b210c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a3bed7-12f6-4c32-86fd-35924b210c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c452ca50-ec19-4f82-a527-47d3aa7ca523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Volume 6e8d3384-0cf8-479b-b695-5d536c9953c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8d3384-0cf8-479b-b695-5d536c9953c1', 'volume_size': 1} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107527873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8d3384-0cf8-479b-b695-5d536c9953c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:28Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Creating volume 6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:28 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 1073741824 Nov 06 21:36:28 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:28 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 1073741824" returned: 0 in 0.400s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 Nov 06 21:36:28 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:28 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1" returned: 0 in 0.254s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.664s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c452ca50-ec19-4f82-a527-47d3aa7ca523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8d3384-0cf8-479b-b695-5d536c9953c1', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb822d0-f92b-4a23-a3de-9a6bf4504cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Creating offline snapshot 007f3d91-a32c-4a49-8c0b-633b2e20c56b of volume 33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:28 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Volume volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 (6e8d3384-0cf8-479b-b695-5d536c9953c1): created successfully Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb822d0-f92b-4a23-a3de-9a6bf4504cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (87542940-b2d8-46f1-807c-2c94013c421f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20b9a3-03f2-4eb8-a183-d16212adf505]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:28 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c86e3277-951e-4aae-845a-2e31b798b02c tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:36:28 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 Nov 06 21:36:28 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" returned: 0 in 0.396s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b 1G Nov 06 21:36:29 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:29 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b 1G" returned: 0 in 0.431s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:29 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b Nov 06 21:36:29 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b is being set with open permissions: ugo+rw Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b Nov 06 21:36:30 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:30 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info Nov 06 21:36:30 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info is being set with open permissions: ugo+rw Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:30 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info Nov 06 21:36:30 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:30 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.info" returned: 0 in 0.250s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.631s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot 22242e81-f265-4104-b751-267b85bc29fb of volume 6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4c4642c6-2305-4dab-b384-2326f2036964 tempest-ProjectReaderTests-1159230339 None] Create snapshot completed successfully Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a449e597-f6b0-40da-a18f-b5a1372ca1a8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 Nov 06 21:36:31 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:31 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1" returned: 0 in 0.383s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb 1G Nov 06 21:36:31 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:31 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb 1G" returned: 0 in 0.417s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:31 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb Nov 06 21:36:31 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:32 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb" returned: 0 in 0.389s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb is being set with open permissions: ugo+rw Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:32 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb Nov 06 21:36:32 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-007f3d91-a32c-4a49-8c0b-633b2e20c56b-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-007f3d91-a32c-4a49-8c0b-633b2e20c56b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:32 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-007f3d91-a32c-4a49-8c0b-633b2e20c56b" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.306s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-007f3d91-a32c-4a49-8c0b-633b2e20c56b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Deleting offline snapshot 007f3d91-a32c-4a49-8c0b-633b2e20c56b of volume 33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] snapshot_file for this snap is: volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:32 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0895af4-e170-42c1-9123-711b1575c297]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info Nov 06 21:36:32 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b Nov 06 21:36:32 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info" returned: 0 in 0.287s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info is being set with open permissions: ugo+rw Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:32 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info Nov 06 21:36:32 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:32 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b" returned: 0 in 0.437s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eed6dee-c4f2-4630-8bdd-936c396fd87b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 Nov 06 21:36:33 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.info" returned: 0 in 0.324s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4bbfc98d-d5d2-40c2-95c1-d9ee4477ea1c tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:36:33 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" returned: 0 in 0.431s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-22242e81-f265-4104-b751-267b85bc29fb-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:33 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b Nov 06 21:36:33 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-22242e81-f265-4104-b751-267b85bc29fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-6e8d3384-0cf8-479b-b695-5d536c9953c1" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6e8d3384-0cf8-479b-b695-5d536c9953c1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-22242e81-f265-4104-b751-267b85bc29fb" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-22242e81-f265-4104-b751-267b85bc29fb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot 22242e81-f265-4104-b751-267b85bc29fb of volume 6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0137dd-2643-40cc-8821-864cb18186f6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb Nov 06 21:36:33 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:33 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b" returned: 0 in 0.416s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:33 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b Nov 06 21:36:33 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb" returned: 0 in 0.425s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e8d3384-0cf8-479b-b695-5d536c9953c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5a050-cf05-46d3-98a3-dc809a292ee2]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8.007f3d91-a32c-4a49-8c0b-633b2e20c56b" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 Nov 06 21:36:34 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-007f3d91-a32c-4a49-8c0b-633b2e20c56b" released by "_delete_snapshot" :: held 1.741s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" released by "delete_snapshot" :: held 1.779s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Created reservations ['19a0b1e5-08fe-4c72-acb5-48d8a51c77eb', '968413f1-7a6c-4c0d-be55-a8cdb139f40e', '15f39701-45c0-444b-9650-5a2b503ccb37', 'c1914725-55cd-4c3b-800d-850c333af7fa'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:34 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Delete snapshot completed successfully. Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ecd6403-ad45-4106-a86c-44a0cae7ff7d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-007f3d91-a32c-4a49-8c0b-633b2e20c56b-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:34 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1" returned: 0 in 0.420s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb Nov 06 21:36:34 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-33e272c6-07ef-41ef-9eec-6ec62f6abaa8-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-33e272c6-07ef-41ef-9eec-6ec62f6abaa8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[528c6151-487b-41bd-a01e-7a1e72b5f33b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 Nov 06 21:36:34 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:34 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb" returned: 0 in 0.460s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:34 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb Nov 06 21:36:34 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" returned: 0 in 0.409s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8 Nov 06 21:36:35 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1.22242e81-f265-4104-b751-267b85bc29fb" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-22242e81-f265-4104-b751-267b85bc29fb" released by "_delete_snapshot" :: held 1.731s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6e8d3384-0cf8-479b-b695-5d536c9953c1" released by "delete_snapshot" :: held 1.759s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Created reservations ['df5c199c-e107-4843-ae08-7126dbea1786', '8231c70f-5d8e-45c8-a366-ed9a0e76e9b5', 'bc11def9-08b1-460d-a2af-39fe8d32d5ef', 'e43f1839-ef0a-4568-becd-a665d6b672fc'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-993a28b1-1cda-4fd4-b0dc-c49d60a4e794 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-22242e81-f265-4104-b751-267b85bc29fb-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:35 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" returned: 0 in 0.295s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-33e272c6-07ef-41ef-9eec-6ec62f6abaa8" released by "delete_volume" :: held 0.785s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Created reservations ['d1f8e879-07ba-4b25-9388-00fcdd86ec06', '9273740d-1bf1-4665-813e-5018e0eb9760', '856e0a21-6bb6-48b4-8378-4589f2904678', '6e3377ab-8108-4c67-9f95-ebd04f4cc32e'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:35 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-6e8d3384-0cf8-479b-b695-5d536c9953c1-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-6e8d3384-0cf8-479b-b695-5d536c9953c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-6e8d3384-0cf8-479b-b695-5d536c9953c1" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6e8d3384-0cf8-479b-b695-5d536c9953c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf592d73-03b5-4e2c-b427-16e7a6d179e4]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:35 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.335s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:35 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Deleted volume successfully. Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e438c549-0281-4de3-9213-44ae7fccb9d8 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-33e272c6-07ef-41ef-9eec-6ec62f6abaa8-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:36 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 Nov 06 21:36:36 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:36 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (69f88342-757d-4ac7-9313-bbe1275ab9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29cb11b0-57c7-4c30-8821-5dd4950039ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1" returned: 0 in 0.709s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1 Nov 06 21:36:36 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29cb11b0-57c7-4c30-8821-5dd4950039ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011814813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff1fe72-5472-4ad9-912b-cdb91a097afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:36Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf4b590-8daf-4e49-b8a1-19762f2f4b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf4b590-8daf-4e49-b8a1-19762f2f4b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ded99c-42fa-4abd-bd15-d1458663508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ded99c-42fa-4abd-bd15-d1458663508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff1fe72-5472-4ad9-912b-cdb91a097afc', 'volume_name': 'volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdf8170-cf94-420e-af2b-cd2dfd61ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdf8170-cf94-420e-af2b-cd2dfd61ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8394bc8b-eb96-47b3-b0f5-51af4bd8fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:36 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Volume 0ff1fe72-5472-4ad9-912b-cdb91a097afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc', 'volume_size': 1} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011814813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff1fe72-5472-4ad9-912b-cdb91a097afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:36Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Creating volume 0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:36 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:36 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc 1073741824 Nov 06 21:36:36 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:36 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6e8d3384-0cf8-479b-b695-5d536c9953c1" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6e8d3384-0cf8-479b-b695-5d536c9953c1" released by "delete_volume" :: held 1.090s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:36 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Created reservations ['f31b9fd6-fd67-448f-9628-ace37528b968', '16f07569-35d7-4091-875c-d53207a1720b', 'f663004b-ed10-402b-8361-157ad28f1d46', '1068e2c5-4ce4-4329-8dfe-09c608d86af8'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:37 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc 1073741824" returned: 0 in 0.539s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:37 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc Nov 06 21:36:37 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:37 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.423s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-cef4322d-84ad-495e-ae0c-29706f418e0a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-6e8d3384-0cf8-479b-b695-5d536c9953c1-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:37 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc" returned: 0 in 0.342s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8394bc8b-eb96-47b3-b0f5-51af4bd8fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecef5ac-2d75-40f3-9d86-23e54a62d5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Volume volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc (0ff1fe72-5472-4ad9-912b-cdb91a097afc): created successfully Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecef5ac-2d75-40f3-9d86-23e54a62d5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (69f88342-757d-4ac7-9313-bbe1275ab9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a9871b4b-b2b9-40bd-b2d5-16672ec30fac tempest-ProjectReaderTests-1159230339 None] Created volume successfully. Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (385ba829-0df9-4626-b143-81f8c6b011c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765eef91-e7dd-4e1c-955e-5acbaded8398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765eef91-e7dd-4e1c-955e-5acbaded8398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676355880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:38Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c0945d-d499-4ac4-aff6-90b76dcb1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c0945d-d499-4ac4-aff6-90b76dcb1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3321523a-e463-4b36-9b3f-965f513af73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3321523a-e463-4b36-9b3f-965f513af73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c', 'volume_name': 'volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ef7ae-15cf-41e5-a61f-a748ef6997e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ef7ae-15cf-41e5-a61f-a748ef6997e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5014d111-c299-4ebe-9a06-d2ed0519f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:38 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Volume 6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c', 'volume_size': 1} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676355880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:38Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Creating volume 6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c 1073741824 Nov 06 21:36:38 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:39 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c 1073741824" returned: 0 in 0.579s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c Nov 06 21:36:39 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" returned: 0 in 0.277s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.514s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5014d111-c299-4ebe-9a06-d2ed0519f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997fa918-7e31-4bbb-82ba-098a43b76947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Creating offline snapshot 94064819-a3ec-464a-95b5-1e7d50b4c842 of volume 0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Volume volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c (6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c): created successfully Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997fa918-7e31-4bbb-82ba-098a43b76947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (385ba829-0df9-4626-b143-81f8c6b011c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2429d-49b5-448b-b33a-346ec51efc7a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2b20218d-a76f-41ad-802b-1f8ef396ec19 tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:36:39 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc Nov 06 21:36:39 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 1G Nov 06 21:36:40 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 1G" returned: 0 in 0.393s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 Nov 06 21:36:40 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:40 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:40 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 is being set with open permissions: ugo+rw Nov 06 21:36:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:40 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 Nov 06 21:36:40 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info Nov 06 21:36:41 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info" returned: 0 in 0.266s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info is being set with open permissions: ugo+rw Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info Nov 06 21:36:41 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:41 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.info" returned: 0 in 0.234s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.838s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot c6420b20-7b02-4524-b492-18e61e8cee0d of volume 6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1de77a46-8ac3-4c31-9414-fb058fbad24a tempest-ProjectReaderTests-1159230339 None] Create snapshot completed successfully Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[11843803-408d-4a79-b2ab-6fdca5aeff07]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:41 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c Nov 06 21:36:41 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" returned: 0 in 0.465s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-94064819-a3ec-464a-95b5-1e7d50b4c842-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:42 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d 1G Nov 06 21:36:42 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-94064819-a3ec-464a-95b5-1e7d50b4c842-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-0ff1fe72-5472-4ad9-912b-cdb91a097afc" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-0ff1fe72-5472-4ad9-912b-cdb91a097afc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-94064819-a3ec-464a-95b5-1e7d50b4c842" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-94064819-a3ec-464a-95b5-1e7d50b4c842" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Deleting offline snapshot 94064819-a3ec-464a-95b5-1e7d50b4c842 of volume 0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] snapshot_file for this snap is: volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d0389e-4420-43ce-823d-b9fc9ea44c4c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 Nov 06 21:36:42 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d 1G" returned: 0 in 0.536s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842" returned: 0 in 0.431s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:42 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d Nov 06 21:36:42 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12443c-7220-41c2-8c02-fd8525c85c7f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:42 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc Nov 06 21:36:42 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d" returned: 0 in 0.346s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d is being set with open permissions: ugo+rw Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d Nov 06 21:36:43 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc" returned: 0 in 0.459s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 Nov 06 21:36:43 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d" returned: 0 in 0.304s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info Nov 06 21:36:43 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842" returned: 0 in 0.420s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:43 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info is being set with open permissions: ugo+rw Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:43 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842 Nov 06 21:36:43 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info Nov 06 21:36:43 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:43 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc.94064819-a3ec-464a-95b5-1e7d50b4c842" returned: 0 in 0.307s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-94064819-a3ec-464a-95b5-1e7d50b4c842" released by "_delete_snapshot" :: held 1.762s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-0ff1fe72-5472-4ad9-912b-cdb91a097afc" released by "delete_snapshot" :: held 1.796s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.info" returned: 0 in 0.353s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3afd3be3-40b7-4bec-90aa-6c1ab9f2d100 tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Created reservations ['8c96010a-ad85-4a50-91d4-c11765b7b03f', '69df1939-ded5-4d1a-834f-d0a2e243072b', 'c76c9bf2-ca63-4952-b527-832ef09aef29', 'c88a6c3f-5afb-479b-adc6-82750fcfceb0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:44 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Delete snapshot completed successfully. Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e55b89bd-0b12-47ba-bbea-4d9a99c00112 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-94064819-a3ec-464a-95b5-1e7d50b4c842-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-0ff1fe72-5472-4ad9-912b-cdb91a097afc-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-0ff1fe72-5472-4ad9-912b-cdb91a097afc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-0ff1fe72-5472-4ad9-912b-cdb91a097afc" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-0ff1fe72-5472-4ad9-912b-cdb91a097afc" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bc8d14-2a4d-4395-bbec-c143c47b8edb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc Nov 06 21:36:44 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc" returned: 0 in 0.397s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:44 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc Nov 06 21:36:44 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-c6420b20-7b02-4524-b492-18e61e8cee0d-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Lock "cinder-c6420b20-7b02-4524-b492-18e61e8cee0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:44 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-c6420b20-7b02-4524-b492-18e61e8cee0d" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-c6420b20-7b02-4524-b492-18e61e8cee0d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot c6420b20-7b02-4524-b492-18e61e8cee0d of volume 6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc21f0fe-7e1e-4e00-b8b9-9b974b3447bf]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:45 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d Nov 06 21:36:45 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:45 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0ff1fe72-5472-4ad9-912b-cdb91a097afc" returned: 0 in 0.391s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-0ff1fe72-5472-4ad9-912b-cdb91a097afc" released by "delete_volume" :: held 0.858s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Created reservations ['1d76e906-3c03-43b2-ac11-9cb04daae421', '049839fc-dd79-4f75-8a38-03f3ba98c9d8', '8fa896b4-36a4-4de1-8c45-c862e09a4cfd', '306e72ef-eee2-4e56-91bd-ab523d3aef9f'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:45 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:45 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:45 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d" returned: 0 in 0.462s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3e4d9-56f2-44d0-82d4-c58e990b2313]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:45 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.289s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Deleted volume successfully. Nov 06 21:36:45 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c Nov 06 21:36:45 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:45 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9c7c7252-0191-4f29-bc55-fc6163b6d260 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-0ff1fe72-5472-4ad9-912b-cdb91a097afc-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (92f35008-3f16-4681-8c20-83b74e3270c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:46 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0b1cda-d104-4814-98af-53630522bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" returned: 0 in 0.510s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0b1cda-d104-4814-98af-53630522bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180283181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15e6773-0d4c-4829-ad61-f0c5d3649a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:46Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:46 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d Nov 06 21:36:46 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8ef2ca-4829-44c5-9a7b-dd5f05dd9928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8ef2ca-4829-44c5-9a7b-dd5f05dd9928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884756c7-8469-4917-a86f-5f7abaca41d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884756c7-8469-4917-a86f-5f7abaca41d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15e6773-0d4c-4829-ad61-f0c5d3649a1b', 'volume_name': 'volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42f41db-86d1-4fa9-9ed2-272fb6c7a213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42f41db-86d1-4fa9-9ed2-272fb6c7a213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af45007-e0b5-4194-8e62-3e0580c357be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:46 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Volume b15e6773-0d4c-4829-ad61-f0c5d3649a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b', 'volume_size': 1} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180283181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15e6773-0d4c-4829-ad61-f0c5d3649a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:46Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Creating volume b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:46 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b 1073741824 Nov 06 21:36:46 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d" returned: 0 in 0.396s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d Nov 06 21:36:46 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b 1073741824" returned: 0 in 0.537s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:46 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:46 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c.c6420b20-7b02-4524-b492-18e61e8cee0d" returned: 0 in 0.276s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:46 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-c6420b20-7b02-4524-b492-18e61e8cee0d" released by "_delete_snapshot" :: held 1.826s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" released by "delete_snapshot" :: held 1.860s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Created reservations ['575da13b-8b21-489b-9791-42915ddb9963', '16224967-05e0-4399-aeea-7e64e762b0a2', 'c316170a-a7a2-40e2-b8c5-de8aedc02d04', '0701445f-df5b-4689-a900-3502167d3e78'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:46 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:36:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-58ac4d00-a193-49cd-90fc-86f5c2d2a40f tempest-ProjectMemberTests-1707644949 None] Lock "cinder-c6420b20-7b02-4524-b492-18e61e8cee0d-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:47 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" returned: 0 in 0.281s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af45007-e0b5-4194-8e62-3e0580c357be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27b0839-3937-41d8-9200-01f85f8217d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:47 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Volume volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b (b15e6773-0d4c-4829-ad61-f0c5d3649a1b): created successfully Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27b0839-3937-41d8-9200-01f85f8217d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (92f35008-3f16-4681-8c20-83b74e3270c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-39086fcf-1a38-452d-a14f-7d6a51064441 tempest-ProjectReaderTests-1159230339 None] Created volume successfully. Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Lock "cinder-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd968ac-a98c-4036-b531-9531daddf478]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c Nov 06 21:36:47 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:47 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" returned: 0 in 0.345s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:47 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c Nov 06 21:36:47 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:47 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" returned: 0 in 0.250s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c" released by "delete_volume" :: held 0.656s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Created reservations ['2f09b953-2d80-4b30-9768-a248aa7872d7', '37ecdbf5-3432-44a4-88a2-55942c0f2257', '0217b7a2-13af-4b5f-9a34-431ae4fc292c', '57ec6b40-6e03-464c-89f6-4d78b52d74be'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:48 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:48 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Creating offline snapshot ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd of volume b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c1f7d-fee3-4be9-bd87-0b7d1a9cc097]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:48 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.510s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:48 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-bd8ca1d9-4d29-495c-aabd-06818de840be tempest-ProjectMemberTests-1707644949 None] Lock "cinder-6c4496d6-b4a6-4b3b-91a8-10bb6a0a084c-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:48 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b Nov 06 21:36:48 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:48 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" returned: 0 in 0.541s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd 1G Nov 06 21:36:49 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (b8dc45bf-1832-4cf1-ae59-74772eca5fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace06079-21ae-4fb6-99fc-fcc0079d5f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace06079-21ae-4fb6-99fc-fcc0079d5f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359311404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4531475-c647-48f3-a3d8-dae44c695f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:49Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891cf0c8-6760-4a77-9af1-e2aee2eac37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891cf0c8-6760-4a77-9af1-e2aee2eac37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9adbe1b-2b4e-431c-a531-3958c772b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9adbe1b-2b4e-431c-a531-3958c772b254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4531475-c647-48f3-a3d8-dae44c695f1a', 'volume_name': 'volume-f4531475-c647-48f3-a3d8-dae44c695f1a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05104f0-49f0-4e59-ac58-b35466e627be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05104f0-49f0-4e59-ac58-b35466e627be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f653764-0b26-42ac-8bb8-d7adb46cd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Volume f4531475-c647-48f3-a3d8-dae44c695f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4531475-c647-48f3-a3d8-dae44c695f1a', 'volume_size': 1} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:49 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd 1G" returned: 0 in 0.548s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd Nov 06 21:36:49 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:49 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:49 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd is being set with open permissions: ugo+rw Nov 06 21:36:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:49 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd Nov 06 21:36:49 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:50 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:50 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info Nov 06 21:36:50 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:50 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info" returned: 0 in 0.309s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info is being set with open permissions: ugo+rw Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:50 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info Nov 06 21:36:50 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:50 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.info" returned: 0 in 0.334s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359311404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4531475-c647-48f3-a3d8-dae44c695f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:49Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Creating volume f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:50 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:50 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a 1073741824 Nov 06 21:36:51 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ad49ac47-e0df-413c-a3cb-b8d4b854fe58 tempest-ProjectReaderTests-1159230339 None] Create snapshot completed successfully Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:51 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a 1073741824" returned: 0 in 0.718s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Deleting offline snapshot ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd of volume b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] snapshot_file for this snap is: volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbfedff-c68e-439a-a71b-d1926f2cd861]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:51 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a Nov 06 21:36:51 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:51 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd Nov 06 21:36:51 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:52 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a" returned: 0 in 0.315s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f653764-0b26-42ac-8bb8-d7adb46cd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4531475-c647-48f3-a3d8-dae44c695f1a', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a35e9e7-8b3d-4b2a-8307-d11af7ce0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:52 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Volume volume-f4531475-c647-48f3-a3d8-dae44c695f1a (f4531475-c647-48f3-a3d8-dae44c695f1a): created successfully Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a35e9e7-8b3d-4b2a-8307-d11af7ce0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (b8dc45bf-1832-4cf1-ae59-74772eca5fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-27b4c5cb-9fa2-418c-8b39-9f0786b26885 tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:36:52 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac1607-558b-4103-9fe2-ad7071a9fc19]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b Nov 06 21:36:52 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 of volume f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f1d636-b8e0-4cfe-bd47-67282ccac1c5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" returned: 0 in 0.474s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:52 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd Nov 06 21:36:52 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:52 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a Nov 06 21:36:52 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a" returned: 0 in 0.449s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:53 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" returned: 0 in 0.443s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:53 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 1G Nov 06 21:36:53 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd Nov 06 21:36:53 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b.ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" returned: 0 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd" released by "_delete_snapshot" :: held 1.804s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" released by "delete_snapshot" :: held 1.833s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Created reservations ['5fdfbf38-75eb-4c9a-ba77-5b03855eb6a1', '3770f346-a0df-4226-b69c-8256f3a16c91', '2a588ad7-f605-49d8-b995-d6cc5f38d9bd', '2f894020-35b9-4aeb-8003-afc3a53193d4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:53 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Delete snapshot completed successfully. Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f9753ee2-cbd1-4fb5-a55e-c5e737629f65 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-ed5cbd28-68e3-4e0a-b2fa-ea1abcb974dd-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:53 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 1G" returned: 0 in 0.604s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4531475-c647-48f3-a3d8-dae44c695f1a -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:53 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4531475-c647-48f3-a3d8-dae44c695f1a -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 Nov 06 21:36:53 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-b15e6773-0d4c-4829-ad61-f0c5d3649a1b-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-b15e6773-0d4c-4829-ad61-f0c5d3649a1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[92003607-95b4-4add-a2f2-8b018b58f56f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4531475-c647-48f3-a3d8-dae44c695f1a -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" returned: 0 in 0.393s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 is being set with open permissions: ugo+rw Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 Nov 06 21:36:54 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b Nov 06 21:36:54 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" returned: 0 in 0.269s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" returned: 0 in 0.410s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info Nov 06 21:36:54 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b Nov 06 21:36:54 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:54 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Flow 'volume_create_manager' (d7df36a2-5c74-4005-b5ab-2f56158a7246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e4340e-a1a2-49d5-91fd-4578e3fea07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" returned: 0 in 0.326s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info" returned: 0 in 0.359s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:54 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info is being set with open permissions: ugo+rw Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:54 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e4340e-a1a2-49d5-91fd-4578e3fea07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1196031438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8fd311-6f42-446a-ba56-4dbc06f7863c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e26b0ee77164443a98b90615c4b4d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:55Z,use_quota=True,user_id='ac62a05418b64207bc4a8d7f5dc382d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:54 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e399b5-051a-4e08-bcd7-3b5d1a5af3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e399b5-051a-4e08-bcd7-3b5d1a5af3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd1e0b0-77dc-4ba6-a078-6abe796afab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd1e0b0-77dc-4ba6-a078-6abe796afab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8fd311-6f42-446a-ba56-4dbc06f7863c', 'volume_name': 'volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fe7555-4d7b-4726-8c2c-edbd41908276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fe7555-4d7b-4726-8c2c-edbd41908276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1fe270-cfa0-4c0d-bd87-64a9d1ca8dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:54 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Volume 1c8fd311-6f42-446a-ba56-4dbc06f7863c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c', 'volume_size': 1} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-b15e6773-0d4c-4829-ad61-f0c5d3649a1b" released by "delete_volume" :: held 0.872s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Created reservations ['4d97eccd-d7b1-4975-9a2f-dba9743a778c', 'b2b65b06-172b-4a28-9610-8bf5fd967c9d', '8500947b-5c14-4dd5-8809-289d26abaae4', '5a0fec75-1f1a-4956-8c75-4eeff98812c8'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:55 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.info" returned: 0 in 0.276s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.240s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1196031438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8fd311-6f42-446a-ba56-4dbc06f7863c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e26b0ee77164443a98b90615c4b4d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:55Z,use_quota=True,user_id='ac62a05418b64207bc4a8d7f5dc382d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Creating volume 1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c 1073741824 Nov 06 21:36:55 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a2c08a7e-cc41-4cd3-a6cc-dad9ac887da9 tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:36:55 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.266s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Deleted volume successfully. Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f6917ff-d5f3-4bad-8e3b-6fa3e906dc4d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-b15e6773-0d4c-4829-ad61-f0c5d3649a1b-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (52ae192d-1e34-41ac-a4ab-277a1f535653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0d573d-5321-4509-8c87-1329929b481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0d573d-5321-4509-8c87-1329929b481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451120258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6ef7d7-bd09-407c-97f7-c0586edcd079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:55Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5fb4da-1ec4-49a8-bf64-e8a94dc29fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5fb4da-1ec4-49a8-bf64-e8a94dc29fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a29501-3451-4804-829b-51dc15109d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:55 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a29501-3451-4804-829b-51dc15109d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6ef7d7-bd09-407c-97f7-c0586edcd079', 'volume_name': 'volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3840954a-1413-446a-abf3-d075407dd265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3840954a-1413-446a-abf3-d075407dd265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0182f21c-31cc-49fa-8e2a-b04e274db37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Volume fc6ef7d7-bd09-407c-97f7-c0586edcd079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079', 'volume_size': 1} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c 1073741824" returned: 0 in 0.514s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c Nov 06 21:36:55 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-f4531475-c647-48f3-a3d8-dae44c695f1a" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-f4531475-c647-48f3-a3d8-dae44c695f1a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 of volume f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f5d2c7-fa95-4337-a1b8-b59e6a32186c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c" returned: 0 in 0.274s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451120258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6ef7d7-bd09-407c-97f7-c0586edcd079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:36:55Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Creating volume fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1fe270-cfa0-4c0d-bd87-64a9d1ca8dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f337c5-95c2-432b-aaa6-3fbaaae4e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:55 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 1073741824 Nov 06 21:36:55 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Volume volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c (1c8fd311-6f42-446a-ba56-4dbc06f7863c): created successfully Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f337c5-95c2-432b-aaa6-3fbaaae4e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:55 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Flow 'volume_create_manager' (d7df36a2-5c74-4005-b5ab-2f56158a7246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:55 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bf3b7c74-576c-4e9b-b84b-38d239ea7643 tempest-SnapshotDependencyTests-1637975195 None] Created volume successfully. Nov 06 21:36:56 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 Nov 06 21:36:56 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:56 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" returned: 0 in 0.400s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4531475-c647-48f3-a3d8-dae44c695f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6405f4-e7d9-448b-9a41-4f5ea5d10c96]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:56 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 1073741824" returned: 0 in 0.440s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:56 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a Nov 06 21:36:56 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:56 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 Nov 06 21:36:56 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:56 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:56 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a" returned: 0 in 0.353s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0182f21c-31cc-49fa-8e2a-b04e274db37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d798a1e-3ba1-45f4-a9df-fb380e192aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:56 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 Nov 06 21:36:56 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:56 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Volume volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 (fc6ef7d7-bd09-407c-97f7-c0586edcd079): created successfully Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d798a1e-3ba1-45f4-a9df-fb380e192aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:56 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (52ae192d-1e34-41ac-a4ab-277a1f535653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-856487d1-6f09-4a36-b6e9-01c25634eecd tempest-ProjectReaderTests-1159230339 None] Created volume successfully. Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Creating offline snapshot e70f3a9c-a8f9-4487-982c-b553543708ef of volume 1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:57 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" returned: 0 in 0.390s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f91b59-f795-4bb1-9ab3-2e9196b9c8bb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:57 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06 Nov 06 21:36:57 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:57 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c Nov 06 21:36:57 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:57 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a.a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" returned: 0 in 0.271s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06" released by "_delete_snapshot" :: held 1.524s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-f4531475-c647-48f3-a3d8-dae44c695f1a" released by "delete_snapshot" :: held 1.547s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Created reservations ['04639047-4695-4956-8bed-2ed3ba619aac', '10edc74b-313a-4441-86ef-d65c9061fd13', 'ae23d7d8-8e48-4806-9246-6223ec2ffcf7', 'bfb12e90-d49f-4835-b16f-f44351ea4834'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:57 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c" returned: 0 in 0.403s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:57 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef 1G Nov 06 21:36:57 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:57 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-6f1b6027-46b4-4cf5-97aa-ac2e626542d4 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-a41087f9-4c0b-4a6b-8fd5-6b5f2288bc06-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:57 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef 1G" returned: 0 in 0.450s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:57 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:57 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef Nov 06 21:36:57 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-f4531475-c647-48f3-a3d8-dae44c695f1a-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Lock "cinder-f4531475-c647-48f3-a3d8-dae44c695f1a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-f4531475-c647-48f3-a3d8-dae44c695f1a" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-f4531475-c647-48f3-a3d8-dae44c695f1a" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[728f585d-b628-42ad-bf7b-a7080a3aa30e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a Nov 06 21:36:58 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef" returned: 0 in 0.348s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef is being set with open permissions: ugo+rw Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef Nov 06 21:36:58 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a" returned: 0 in 0.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef" returned: 0 in 0.242s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a Nov 06 21:36:58 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info Nov 06 21:36:58 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-f4531475-c647-48f3-a3d8-dae44c695f1a" returned: 0 in 0.254s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-f4531475-c647-48f3-a3d8-dae44c695f1a" released by "delete_volume" :: held 0.690s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:58 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info" returned: 0 in 0.276s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:58 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info is being set with open permissions: ugo+rw Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info Nov 06 21:36:58 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Created reservations ['ef38faac-119e-49ea-9c8a-bced57b1263d', 'cee08e98-2cf6-47c6-8198-ee32457ad574', '6afd9d2b-a599-42f1-b05d-eeb3e7f5d095', '1a6368cb-502a-47be-8071-087610f25b49'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:58 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:58 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:36:58 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:59 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.info" returned: 0 in 0.265s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.359s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Creating offline snapshot 5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc of volume fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:36:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a4b25b5a-dd1a-4a56-9771-a6cdd1348d28 tempest-SnapshotDependencyTests-1637975195 None] Create snapshot completed successfully Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df8210-f645-4c07-a140-8c51fa4cea90]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:59 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.297s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:59 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-29e8f91f-9a12-4457-9543-2a997fd644ff tempest-ProjectMemberTests-1707644949 None] Lock "cinder-f4531475-c647-48f3-a3d8-dae44c695f1a-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:36:59 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 Nov 06 21:36:59 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:59 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079" returned: 0 in 0.417s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:59 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc 1G Nov 06 21:36:59 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (f0806bd5-2d74-42fc-9b04-6a94baf025de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fdb62d-af8f-46ef-9b8e-b3c088731b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fdb62d-af8f-46ef-9b8e-b3c088731b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-562461367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f46c1f-5760-4495-98b0-16eeb24e8005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:00Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095ee35f-1930-4a02-a662-dec3577cb30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095ee35f-1930-4a02-a662-dec3577cb30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef7e7a4-077d-402d-8591-bc44a6bc8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef7e7a4-077d-402d-8591-bc44a6bc8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f46c1f-5760-4495-98b0-16eeb24e8005', 'volume_name': 'volume-95f46c1f-5760-4495-98b0-16eeb24e8005', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c25da8a-9cbd-464d-be7a-eade2fa43b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c25da8a-9cbd-464d-be7a-eade2fa43b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079a12f7-8e4c-49f4-b3f1-0e1c957d3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:36:59 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Volume 95f46c1f-5760-4495-98b0-16eeb24e8005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f46c1f-5760-4495-98b0-16eeb24e8005', 'volume_size': 1} Nov 06 21:36:59 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:00 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc 1G" returned: 0 in 0.414s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc Nov 06 21:37:00 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:00 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" returned: 0 in 0.308s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:00 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc is being set with open permissions: ugo+rw Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc Nov 06 21:37:00 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:00 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" returned: 0 in 0.283s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info Nov 06 21:37:00 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Flow 'volume_create_manager' (4701337b-b640-4bcd-b044-ccac4179a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef0e8bb-63f3-48ba-a32f-02b06336d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef0e8bb-63f3-48ba-a32f-02b06336d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84a1cec-73c9-480e-9e35-8285c6d3cf4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e26b0ee77164443a98b90615c4b4d81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e70f3a9c-a8f9-4487-982c-b553543708ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:01Z,use_quota=True,user_id='ac62a05418b64207bc4a8d7f5dc382d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e10349c-0eb1-466b-b898-682af29cf27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e10349c-0eb1-466b-b898-682af29cf27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51da13d5-f569-4b4b-a789-0a1bc569e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51da13d5-f569-4b4b-a789-0a1bc569e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b84a1cec-73c9-480e-9e35-8285c6d3cf4e', 'volume_name': 'volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e', 'volume_size': 1, 'snapshot_id': 'e70f3a9c-a8f9-4487-982c-b553543708ef'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b159aac8-0ada-4980-ae6c-10262fd620a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b159aac8-0ada-4980-ae6c-10262fd620a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f47b95-eaf0-4467-9cb9-f3fcfaf7d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:00 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Volume b84a1cec-73c9-480e-9e35-8285c6d3cf4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e', 'volume_size': 1, 'snapshot_id': 'e70f3a9c-a8f9-4487-982c-b553543708ef'} Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:00 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:00 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info is being set with open permissions: ugo+rw Nov 06 21:37:00 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info Nov 06 21:37:00 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.info" returned: 0 in 0.247s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-562461367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f46c1f-5760-4495-98b0-16eeb24e8005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:00Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Creating volume 95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:01 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 1073741824 Nov 06 21:37:01 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f129a6ed-9d2c-4ebf-8a17-b8e5b3b4ce84 tempest-ProjectReaderTests-1159230339 None] Create snapshot completed successfully Nov 06 21:37:01 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 1073741824" returned: 0 in 0.449s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 Nov 06 21:37:01 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.033s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-quobyte-e70f3a9c-a8f9-4487-982c-b553543708ef-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" by "_create_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079a12f7-8e4c-49f4-b3f1-0e1c957d3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f46c1f-5760-4495-98b0-16eeb24e8005', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002ce371-6b59-47db-bfa4-8d4f800e2c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-e70f3a9c-a8f9-4487-982c-b553543708ef-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Creating volume b84a1cec-73c9-480e-9e35-8285c6d3cf4e from snapshot e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-quobyte-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" by "_copy_volume_from_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:02 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Volume volume-95f46c1f-5760-4495-98b0-16eeb24e8005 (95f46c1f-5760-4495-98b0-16eeb24e8005): created successfully Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002ce371-6b59-47db-bfa4-8d4f800e2c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (f0806bd5-2d74-42fc-9b04-6a94baf025de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] snapshot: e70f3a9c-a8f9-4487-982c-b553543708ef, volume: b84a1cec-73c9-480e-9e35-8285c6d3cf4e, {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-fc6ef7d7-bd09-407c-97f7-c0586edcd079" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:02 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9a7ea27d-6923-40c9-8480-da364a276db9 tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-fc6ef7d7-bd09-407c-97f7-c0586edcd079" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78d9f0-0989-4219-9142-47088e4a1ad5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Deleting offline snapshot 5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc of volume fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] snapshot_file for this snap is: volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e279dc-01d0-4f51-9d02-e27fe62a76ab]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef Nov 06 21:37:02 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc Nov 06 21:37:02 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef" returned: 0 in 0.395s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe4150-f887-4083-88f9-6a484bd2188b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" returned: 0 in 0.377s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c0f6b3-b9e3-4a93-ade1-24423375f455]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c Nov 06 21:37:02 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 Nov 06 21:37:02 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c" returned: 0 in 0.452s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Creating direct copy from snapshot {{(pid=87350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:37:02 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG cinder.utils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Path /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e not found in is_blk_device check {{(pid=87350) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:37:02 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079" returned: 0 in 0.421s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:03 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e Nov 06 21:37:03 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:03 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc Nov 06 21:37:03 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:03 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" returned: 0 in 0.358s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:03 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc Nov 06 21:37:03 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:03 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079.5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" returned: 0 in 0.318s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc" released by "_delete_snapshot" :: held 1.617s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-fc6ef7d7-bd09-407c-97f7-c0586edcd079" released by "delete_snapshot" :: held 1.651s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:03 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Created reservations ['2f001a44-3468-486d-8c22-e1123aa122fc', '6c8e2caf-1e86-49b3-a582-61784526e0cc', '0a866905-aca4-4a77-98ca-2631c7400d7b', '840c71e3-bd2c-43c5-9df4-1c1bc6cafc78'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:03 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Delete snapshot completed successfully. Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-b5baf54e-7a5f-499e-84b4-d91376ffb19d tempest-ProjectReaderTests-1159230339 None] Lock "cinder-5e68eb3b-3a9b-4ab9-8810-82c0cdf495bc-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-fc6ef7d7-bd09-407c-97f7-c0586edcd079-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-fc6ef7d7-bd09-407c-97f7-c0586edcd079-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-fc6ef7d7-bd09-407c-97f7-c0586edcd079" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-fc6ef7d7-bd09-407c-97f7-c0586edcd079" acquired by "delete_volume" :: waited 0.028s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6343f0d-616d-4947-97dc-9a748235a4fe]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:04 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 Nov 06 21:37:04 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:04 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079" returned: 0 in 0.479s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:04 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:04 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079 Nov 06 21:37:04 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:05 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-fc6ef7d7-bd09-407c-97f7-c0586edcd079" returned: 0 in 0.389s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-fc6ef7d7-bd09-407c-97f7-c0586edcd079" released by "delete_volume" :: held 0.997s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Created reservations ['96a3ee0b-e590-4c56-8c92-93a0348e12e9', '5535447d-51d0-464c-946f-fa92f4988941', 'f219b4ac-35c5-4600-a612-253ea8888c57', 'd15e7ca3-c885-4893-9843-1cf05258c97b'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:05 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:05 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:05 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.342s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:05 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Deleted volume successfully. Nov 06 21:37:05 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-310139e9-afd8-4f9b-b4f5-1c0eabe077c5 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-fc6ef7d7-bd09-407c-97f7-c0586edcd079-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (6203de56-4aad-451d-9f68-d9401f54f466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42346d9a-940c-4f79-bb4f-c0479ae410e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42346d9a-940c-4f79-bb4f-c0479ae410e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508006010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210b27cc-bc72-4c26-8d25-55e3dff82698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:07Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0637827b-bd46-46b5-9515-53737ae19959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0637827b-bd46-46b5-9515-53737ae19959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43fc1f0-745a-4ad9-bb12-837f120d4677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43fc1f0-745a-4ad9-bb12-837f120d4677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210b27cc-bc72-4c26-8d25-55e3dff82698', 'volume_name': 'volume-210b27cc-bc72-4c26-8d25-55e3dff82698', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d846423-a07b-4769-a4d6-21a3a86599d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d846423-a07b-4769-a4d6-21a3a86599d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0d6a3b-502e-4c82-bf21-56378c587155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:07 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Volume 210b27cc-bc72-4c26-8d25-55e3dff82698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210b27cc-bc72-4c26-8d25-55e3dff82698', 'volume_size': 1} Nov 06 21:37:07 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:09 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" returned: 0 in 6.579s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.image.image_utils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e {{(pid=87350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:37:09 devstack cinder-volume[87350]: INFO cinder.image.image_utils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Converted 1024.00 MB image at 155.62 MB/s Nov 06 21:37:09 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e is being set with open permissions: ugo+rw Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e Nov 06 21:37:09 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:09 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" returned: 0 in 0.240s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" released by "_copy_volume_from_snapshot" :: held 7.786s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-e70f3a9c-a8f9-4487-982c-b553543708ef-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" released by "_create_volume_from_snapshot" :: held 7.870s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.903s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.823s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 of volume 95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f47b95-eaf0-4467-9cb9-f3fcfaf7d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e', 'volume_size': 1, 'snapshot_id': 'e70f3a9c-a8f9-4487-982c-b553543708ef'}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5532704a-3ba3-4b7e-839f-cd7abfaa0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e328e5b0-cf4f-4b59-aa55-93b2e018944a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:09 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Volume volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e (b84a1cec-73c9-480e-9e35-8285c6d3cf4e): created successfully Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5532704a-3ba3-4b7e-839f-cd7abfaa0988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Flow 'volume_create_manager' (4701337b-b640-4bcd-b044-ccac4179a863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1a383d11-bc5b-4bb6-93d9-9cab5d3b3554 tempest-SnapshotDependencyTests-1637975195 None] Created volume successfully. Nov 06 21:37:10 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 Nov 06 21:37:10 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005" returned: 0 in 0.382s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 1G Nov 06 21:37:10 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-e70f3a9c-a8f9-4487-982c-b553543708ef-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-e70f3a9c-a8f9-4487-982c-b553543708ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-quobyte-1c8fd311-6f42-446a-ba56-4dbc06f7863c" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-1c8fd311-6f42-446a-ba56-4dbc06f7863c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-quobyte-e70f3a9c-a8f9-4487-982c-b553543708ef" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-e70f3a9c-a8f9-4487-982c-b553543708ef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Deleting offline snapshot e70f3a9c-a8f9-4487-982c-b553543708ef of volume 1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] snapshot_file for this snap is: volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26a6b3-022c-4ccc-8ed4-c5388b6535cb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 1G" returned: 0 in 0.420s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f46c1f-5760-4495-98b0-16eeb24e8005 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:10 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f46c1f-5760-4495-98b0-16eeb24e8005 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 Nov 06 21:37:10 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:10 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef Nov 06 21:37:10 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f46c1f-5760-4495-98b0-16eeb24e8005 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" returned: 0 in 0.288s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 is being set with open permissions: ugo+rw Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 Nov 06 21:37:11 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef" returned: 0 in 0.393s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5417b-b0f2-453a-b9a1-9d021433136c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c Nov 06 21:37:11 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info Nov 06 21:37:11 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info is being set with open permissions: ugo+rw Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info Nov 06 21:37:11 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c" returned: 0 in 0.559s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef Nov 06 21:37:11 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.info" returned: 0 in 0.261s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.286s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508006010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210b27cc-bc72-4c26-8d25-55e3dff82698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ddbe7456144f83b4be4b7c9d61b1c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:07Z,use_quota=True,user_id='73ccab7c18b54e76b117ac4249e9c8cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Creating volume 210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:11 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:11 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 1073741824 Nov 06 21:37:11 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e077f699-5181-4fd3-b255-2707efe45f2a tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:37:12 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef" returned: 0 in 0.361s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef Nov 06 21:37:12 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:12 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 1073741824" returned: 0 in 0.471s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c.e70f3a9c-a8f9-4487-982c-b553543708ef" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-e70f3a9c-a8f9-4487-982c-b553543708ef" released by "_delete_snapshot" :: held 1.712s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-1c8fd311-6f42-446a-ba56-4dbc06f7863c" released by "delete_snapshot" :: held 1.752s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:12 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 Nov 06 21:37:12 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Created reservations ['50d478d2-b10c-4f63-93f0-6dee73038fac', '8ab19bdd-e322-4816-9488-b04dc744d56b', '43dfae36-a14c-4353-9be8-0048b4de79f3', '465a81b2-0611-47a8-a01f-6a58bb6b714a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:12 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Delete snapshot completed successfully. Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-dc21692c-2718-47a6-9cb4-223c04ffc610 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-e70f3a9c-a8f9-4487-982c-b553543708ef-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-95f46c1f-5760-4495-98b0-16eeb24e8005" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-95f46c1f-5760-4495-98b0-16eeb24e8005" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 of volume 95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:12 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d15010-59bb-4839-b16a-a467a2b3a788]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0d6a3b-502e-4c82-bf21-56378c587155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210b27cc-bc72-4c26-8d25-55e3dff82698', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0fcd48-aa15-4b23-955b-30ede6539344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:12 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Volume volume-210b27cc-bc72-4c26-8d25-55e3dff82698 (210b27cc-bc72-4c26-8d25-55e3dff82698): created successfully Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0fcd48-aa15-4b23-955b-30ede6539344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Flow 'volume_create_manager' (6203de56-4aad-451d-9f68-d9401f54f466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:12 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e49274a6-34d6-428d-bc3d-fc7e0db9b016 tempest-ProjectReaderTests-1159230339 None] Created volume successfully. Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-1c8fd311-6f42-446a-ba56-4dbc06f7863c-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-1c8fd311-6f42-446a-ba56-4dbc06f7863c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-quobyte-1c8fd311-6f42-446a-ba56-4dbc06f7863c" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-1c8fd311-6f42-446a-ba56-4dbc06f7863c" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9facc-d682-4606-9d53-d54550c2b206]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c Nov 06 21:37:13 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" returned: 0 in 0.426s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f46c1f-5760-4495-98b0-16eeb24e8005(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6566f6b-c1ee-497e-908d-2ec1d4d71686]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 Nov 06 21:37:13 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c" returned: 0 in 0.376s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c Nov 06 21:37:13 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005" returned: 0 in 0.412s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 Nov 06 21:37:13 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-1c8fd311-6f42-446a-ba56-4dbc06f7863c" returned: 0 in 0.295s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-1c8fd311-6f42-446a-ba56-4dbc06f7863c" released by "delete_volume" :: held 0.748s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Created reservations ['271c9738-58c0-494d-a1d6-de50fdc24453', '849e5072-0644-4a56-b71f-5138ba9acad1', 'be057f8f-87da-4a80-a5de-5e0d6ebc041f', '452754e9-d2c2-4d7b-a97f-3d32828c1716'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Creating offline snapshot dbb97fd7-f247-466b-8cea-68ba77bd5529 of volume 210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[139861d5-366e-401d-a720-a49ced804df7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:13 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" returned: 0 in 0.414s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:13 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 Nov 06 21:37:13 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-b84a1cec-73c9-480e-9e35-8285c6d3cf4e-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:14 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4 Nov 06 21:37:14 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-b84a1cec-73c9-480e-9e35-8285c6d3cf4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "cinder-quobyte-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8f34c-c9b0-4274-893a-9c72b7ab1207]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.350s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Deleted volume successfully. Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a6bd1270-ceb1-4523-b980-a0dd7d225108 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-1c8fd311-6f42-446a-ba56-4dbc06f7863c-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:14 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e Nov 06 21:37:14 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698" returned: 0 in 0.487s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005.b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" returned: 0 in 0.362s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 1G Nov 06 21:37:14 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4" released by "_delete_snapshot" :: held 1.741s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-95f46c1f-5760-4495-98b0-16eeb24e8005" released by "delete_snapshot" :: held 1.768s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Created reservations ['02353683-1c01-45b3-96b0-27e8aeacf72d', 'd152093d-7960-481e-9e2c-7290835fa41b', '1a005e7c-8887-4a83-a2d1-05e440ff9bb0', '43df53b8-e3ae-4020-a49f-471e4a21bd49'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c101a2c1-7582-4563-a750-e705944c8258 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-b6eef64b-c054-49b3-adcd-e2dfb6fe2dc4-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:14 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" returned: 0 in 0.428s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e Nov 06 21:37:14 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-95f46c1f-5760-4495-98b0-16eeb24e8005-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-95f46c1f-5760-4495-98b0-16eeb24e8005-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:14 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 1G" returned: 0 in 0.516s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-210b27cc-bc72-4c26-8d25-55e3dff82698 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-95f46c1f-5760-4495-98b0-16eeb24e8005" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-95f46c1f-5760-4495-98b0-16eeb24e8005" acquired by "delete_volume" :: waited 0.020s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:14 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-210b27cc-bc72-4c26-8d25-55e3dff82698 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 Nov 06 21:37:14 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:14 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" returned: 0 in 0.344s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-quobyte-b84a1cec-73c9-480e-9e35-8285c6d3cf4e" released by "delete_volume" :: held 0.815s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c43e7f-da94-4a8f-b00f-46b19ad64e9f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:14 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Created reservations ['983174c2-6614-4b06-8e3b-c9b162a8a42c', 'dd5d9a04-72b8-4bf6-80bf-26d4ec871334', '8391e415-601c-4512-926d-efd60ef92088', '217883c4-56da-4c2a-a5ca-262ae26bf463'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:15 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 Nov 06 21:37:15 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:15 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-210b27cc-bc72-4c26-8d25-55e3dff82698 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529" returned: 0 in 0.342s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 is being set with open permissions: ugo+rw Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 Nov 06 21:37:15 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005" returned: 0 in 0.423s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.319s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:15 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Deleted volume successfully. Nov 06 21:37:15 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005 Nov 06 21:37:15 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-4d875736-7585-4c7d-87ee-1f89375250f0 tempest-SnapshotDependencyTests-1637975195 None] Lock "cinder-b84a1cec-73c9-480e-9e35-8285c6d3cf4e-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:15 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info Nov 06 21:37:15 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-95f46c1f-5760-4495-98b0-16eeb24e8005" returned: 0 in 0.283s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-95f46c1f-5760-4495-98b0-16eeb24e8005" released by "delete_volume" :: held 0.796s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Created reservations ['4ccd37fe-7b04-4883-9c5f-5093b9931994', 'b28b6c24-d1d4-43d8-a9fb-8f5acc5440ba', '9f3ac52e-4ca6-471d-bf80-b3cdf6902865', 'dfe8977c-b96f-4047-9b3b-b5688f111081'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:15 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info" returned: 0 in 0.281s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info is being set with open permissions: ugo+rw Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:15 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info Nov 06 21:37:15 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:15 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:15 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.info" returned: 0 in 0.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.368s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:37:16 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c376329b-a20d-4650-934c-af81b0e1d30c tempest-ProjectReaderTests-1159230339 None] Create snapshot completed successfully Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-7f2fc34f-a564-4fd1-b567-407ac4776565 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-95f46c1f-5760-4495-98b0-16eeb24e8005-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (ccf057e0-4272-4512-938d-f4f7795d302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada52d43-acc1-42ff-9f67-a6ffb9ba4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada52d43-acc1-42ff-9f67-a6ffb9ba4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058508794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:16Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c62bbab-66b8-49c3-88ea-ab6950f6886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c62bbab-66b8-49c3-88ea-ab6950f6886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a18b672-c4c6-46a1-b77f-0645d726a8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a18b672-c4c6-46a1-b77f-0645d726a8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076', 'volume_name': 'volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ab5458-7d90-4d11-b5e2-4ce272e3a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ab5458-7d90-4d11-b5e2-4ce272e3a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa5b403-18bd-4acc-a876-2fa4d51a7c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:16 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Volume 3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076', 'volume_size': 1} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058508794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:16Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Creating volume 3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:16 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:16 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:16 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 1073741824 Nov 06 21:37:16 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-dbb97fd7-f247-466b-8cea-68ba77bd5529-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-dbb97fd7-f247-466b-8cea-68ba77bd5529-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-210b27cc-bc72-4c26-8d25-55e3dff82698" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-210b27cc-bc72-4c26-8d25-55e3dff82698" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-dbb97fd7-f247-466b-8cea-68ba77bd5529" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-dbb97fd7-f247-466b-8cea-68ba77bd5529" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Deleting offline snapshot dbb97fd7-f247-466b-8cea-68ba77bd5529 of volume 210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] snapshot_file for this snap is: volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b33a9-dcb5-4b22-9bec-e18663a90691]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:17 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 1073741824" returned: 0 in 0.573s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:17 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 Nov 06 21:37:17 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:17 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 Nov 06 21:37:17 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:17 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" returned: 0 in 0.290s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa5b403-18bd-4acc-a876-2fa4d51a7c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb210cfd-7b8b-459e-bc3a-d2bba285c1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:17 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529" returned: 0 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-210b27cc-bc72-4c26-8d25-55e3dff82698(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:17 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Volume volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 (3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076): created successfully Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb210cfd-7b8b-459e-bc3a-d2bba285c1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (ccf057e0-4272-4512-938d-f4f7795d302f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b806f-5f27-4799-a7a6-a441fcda7f49]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:17 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-436420fa-9230-478a-baef-3149a10a514a tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:37:17 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 Nov 06 21:37:17 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:17 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698" returned: 0 in 0.375s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:17 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:17 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 Nov 06 21:37:17 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:18 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529" returned: 0 in 0.365s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:18 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529 Nov 06 21:37:18 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:18 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698.dbb97fd7-f247-466b-8cea-68ba77bd5529" returned: 0 in 0.270s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-dbb97fd7-f247-466b-8cea-68ba77bd5529" released by "_delete_snapshot" :: held 1.532s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-210b27cc-bc72-4c26-8d25-55e3dff82698" released by "delete_snapshot" :: held 1.567s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Created reservations ['50a628e4-1a67-4ab0-be4e-bafd27910368', 'b21ac5bb-d672-4a20-ac56-275dcedd4c29', '6f298246-d615-4d5e-9d28-e8a654151cbc', 'ff92ac2a-6079-4524-a8cc-3b6b0433a951'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot cae913cc-ee93-4263-a087-4463f19a5496 of volume 3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:18 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Delete snapshot completed successfully. Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b83036-9c88-4014-b914-95b1556a4294]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:18 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-00c43733-8389-4444-8963-1bbbc4b66b11 tempest-ProjectReaderTests-1159230339 None] Lock "cinder-dbb97fd7-f247-466b-8cea-68ba77bd5529-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:18 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 Nov 06 21:37:18 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:19 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-210b27cc-bc72-4c26-8d25-55e3dff82698-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" returned: 0 in 0.448s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Lock "cinder-210b27cc-bc72-4c26-8d25-55e3dff82698-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:19 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 1G Nov 06 21:37:19 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Acquiring lock "cinder-quobyte-210b27cc-bc72-4c26-8d25-55e3dff82698" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-210b27cc-bc72-4c26-8d25-55e3dff82698" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20982da-14bb-444e-b958-3780937f7662]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:19 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 Nov 06 21:37:19 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:19 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 1G" returned: 0 in 0.521s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:19 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 Nov 06 21:37:19 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:19 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698" returned: 0 in 0.449s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:19 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:19 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698 Nov 06 21:37:19 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496" returned: 0 in 0.360s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 is being set with open permissions: ugo+rw Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 Nov 06 21:37:20 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-210b27cc-bc72-4c26-8d25-55e3dff82698" returned: 0 in 0.383s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Lock "cinder-quobyte-210b27cc-bc72-4c26-8d25-55e3dff82698" released by "delete_volume" :: held 0.944s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Created reservations ['6c6eb8af-1934-43cf-9e2c-392ac54a9fc7', '63c7382e-3989-4cbc-8ffa-560285efbfcc', 'ca8f1993-c1af-42f7-93de-9d4528d660ad', 'b29decc2-8b79-4226-9a7a-fd622606ccbb'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:20 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496" returned: 0 in 0.396s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info Nov 06 21:37:20 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:20 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.251s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:20 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Deleted volume successfully. Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-df24e551-dab9-4179-adac-85419515f4fd tempest-ProjectReaderTests-1159230339 None] Lock "cinder-210b27cc-bc72-4c26-8d25-55e3dff82698-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:20 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info" returned: 0 in 0.294s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:20 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info is being set with open permissions: ugo+rw Nov 06 21:37:20 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:20 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info Nov 06 21:37:20 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:21 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.info" returned: 0 in 0.294s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:21 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:21 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f3bdb0cd-dac2-4dc2-90a8-6a7b9a354ea9 tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-cae913cc-ee93-4263-a087-4463f19a5496-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-cae913cc-ee93-4263-a087-4463f19a5496-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-cae913cc-ee93-4263-a087-4463f19a5496" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-cae913cc-ee93-4263-a087-4463f19a5496" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot cae913cc-ee93-4263-a087-4463f19a5496 of volume 3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62f61b-9d13-4e5b-aadd-546f4a1c33e9]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:22 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 Nov 06 21:37:22 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:22 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496" returned: 0 in 0.394s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e48340-ac72-44a8-99de-5d13a1926eae]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:22 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:22 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 Nov 06 21:37:22 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" returned: 0 in 0.441s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 Nov 06 21:37:23 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:23 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496 Nov 06 21:37:23 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:23 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076.cae913cc-ee93-4263-a087-4463f19a5496" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-cae913cc-ee93-4263-a087-4463f19a5496" released by "_delete_snapshot" :: held 1.670s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" released by "delete_snapshot" :: held 1.698s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=161,cinder:UPDATE=198,cinder:DELETE=12,cinder:INSERT=54 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:UPDATE=193,cinder:SELECT=157,cinder:INSERT=53,cinder:DELETE=22 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Created reservations ['d8eaa497-17ba-433f-89ae-d691553e0e7f', 'bcd1d559-c556-4238-9021-a4688fab1a87', '430e9f57-d623-4ebe-8541-3d89ef398222', 'eff134a0-3979-46cc-abcd-97ddb6909e23'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:23 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:37:23 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2857d849-71c8-40ad-8786-8a7f68740233 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-cae913cc-ee93-4263-a087-4463f19a5496-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[346e26f5-a2f7-412f-8798-bfebfbc32ceb]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 Nov 06 21:37:24 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:24 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" returned: 0 in 0.422s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:24 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:24 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076 Nov 06 21:37:24 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076" released by "delete_volume" :: held 0.870s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Created reservations ['e0275188-01f9-46c0-94e0-761c76997ec0', '6f470f90-42c2-4934-9760-3f8d2e4356b5', '050f501c-16b7-483a-aaaa-82ec8eab8416', '2481c4b4-bd47-408e-a39a-de90855f2b1c'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:25 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:25 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:25 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.331s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:25 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:37:25 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-140d8d12-b3a6-4260-b54b-c55a92330853 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-3ea1d2c6-fc31-4bab-9743-e6fe0c5c9076-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (22c78b98-0864-4c52-a269-5ad8ae272860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bee232a-d187-4c3e-b841-cd3ad9297e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bee232a-d187-4c3e-b841-cd3ad9297e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648387511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf94f00a-faf6-4944-8420-113a7b79b61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:26Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e772b1-1194-47d4-96a6-62095fa6683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e772b1-1194-47d4-96a6-62095fa6683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efc0ac1-170c-45ab-9e4a-f749d579921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efc0ac1-170c-45ab-9e4a-f749d579921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf94f00a-faf6-4944-8420-113a7b79b61f', 'volume_name': 'volume-bf94f00a-faf6-4944-8420-113a7b79b61f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a94d6f-0d8c-454c-bb37-09bb77e20c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a94d6f-0d8c-454c-bb37-09bb77e20c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478aa0d8-b7c8-45b4-8bdc-97985ae1e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Volume bf94f00a-faf6-4944-8420-113a7b79b61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf94f00a-faf6-4944-8420-113a7b79b61f', 'volume_size': 1} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648387511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf94f00a-faf6-4944-8420-113a7b79b61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:26Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Creating volume bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:26 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f 1073741824 Nov 06 21:37:26 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (6a686c87-f33c-4a7a-8d05-6bbcab660216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4cabcd6-294b-469c-89f7-97c7d351b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4cabcd6-294b-469c-89f7-97c7d351b889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223409332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179a6c1f-4dec-4cfb-b9e7-aaa8ced61892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:26Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8d995b-f310-45fb-b9f6-9560060db8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8d995b-f310-45fb-b9f6-9560060db8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4518a28-6b9c-410d-bab8-88e299298fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4518a28-6b9c-410d-bab8-88e299298fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179a6c1f-4dec-4cfb-b9e7-aaa8ced61892', 'volume_name': 'volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd553a8d-9e39-4c51-88f8-ccd388107cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd553a8d-9e39-4c51-88f8-ccd388107cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45769de3-0f8c-4bee-9568-9ef389c45be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:26 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Volume 179a6c1f-4dec-4cfb-b9e7-aaa8ced61892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892', 'volume_size': 1} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:26 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f 1073741824" returned: 0 in 0.461s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:26 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:26 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f Nov 06 21:37:26 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f" returned: 0 in 0.316s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223409332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179a6c1f-4dec-4cfb-b9e7-aaa8ced61892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:26Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Creating volume 179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:27 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478aa0d8-b7c8-45b4-8bdc-97985ae1e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf94f00a-faf6-4944-8420-113a7b79b61f', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:27 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 1073741824 Nov 06 21:37:27 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c33e47-5cc2-4d77-83e4-5d3302b08f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Volume volume-bf94f00a-faf6-4944-8420-113a7b79b61f (bf94f00a-faf6-4944-8420-113a7b79b61f): created successfully Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c33e47-5cc2-4d77-83e4-5d3302b08f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (22c78b98-0864-4c52-a269-5ad8ae272860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a2ae531c-0897-4b2c-84a4-3354982fde03 tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:37:27 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 1073741824" returned: 0 in 0.428s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:27 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 Nov 06 21:37:27 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:27 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892" returned: 0 in 0.241s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45769de3-0f8c-4bee-9568-9ef389c45be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afd2205-1e70-49d3-8479-b20882e8c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:27 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Volume volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 (179a6c1f-4dec-4cfb-b9e7-aaa8ced61892): created successfully Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afd2205-1e70-49d3-8479-b20882e8c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:27 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (6a686c87-f33c-4a7a-8d05-6bbcab660216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:27 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-3f823a01-dac0-4862-a3d6-1fad5f6d6c10 tempest-ProjectReaderTests-1875426540 None] Created volume successfully. Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot 6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 of volume bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2758f34c-9a75-4862-9313-9be76e554528]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f Nov 06 21:37:28 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-quobyte-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc2b17-0b25-4f47-b1aa-b25372dbc898]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f" returned: 0 in 0.366s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:28 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:28 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 Nov 06 21:37:28 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:28 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 1G Nov 06 21:37:28 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892" returned: 0 in 0.363s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892 Nov 06 21:37:29 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 1G" returned: 0 in 0.408s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf94f00a-faf6-4944-8420-113a7b79b61f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf94f00a-faf6-4944-8420-113a7b79b61f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 Nov 06 21:37:29 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892" returned: 0 in 0.272s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892" released by "delete_volume" :: held 0.677s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Created reservations ['19125627-b9a6-4393-9168-3ea2fda5aae7', 'bd4a2677-37d1-4c15-ab1f-23ebbba3fd14', 'ccc32587-3788-460b-8d0b-9f7348ed070b', '9939e7cd-f235-469b-99ef-dd88d6892762'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf94f00a-faf6-4944-8420-113a7b79b61f -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" returned: 0 in 0.320s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 is being set with open permissions: ugo+rw Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:29 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 Nov 06 21:37:29 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:29 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.251s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:29 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Deleted volume successfully. Nov 06 21:37:29 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2fef1504-4d44-41d0-8c7a-0ca64508fb65 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-179a6c1f-4dec-4cfb-b9e7-aaa8ced61892-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" returned: 0 in 0.271s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:29 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:29 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info Nov 06 21:37:29 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info" returned: 0 in 0.279s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info is being set with open permissions: ugo+rw Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info Nov 06 21:37:30 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (ad56e429-7b60-4b8f-8282-a3ac0a4df3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34dd6a1-ef8a-4088-94aa-cf18b34f0f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34dd6a1-ef8a-4088-94aa-cf18b34f0f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368066241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344254b5-5235-4541-9b45-6efdacc62d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:30Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff8d571-6075-452b-84d6-3947079480ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff8d571-6075-452b-84d6-3947079480ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f81604a-5da2-4143-83a4-f076251302ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f81604a-5da2-4143-83a4-f076251302ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344254b5-5235-4541-9b45-6efdacc62d81', 'volume_name': 'volume-344254b5-5235-4541-9b45-6efdacc62d81', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22ac04f-68aa-43da-9fcf-2328706ebe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22ac04f-68aa-43da-9fcf-2328706ebe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c1c1bc-278b-4103-9658-f5e5b4eb1d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:30 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Volume 344254b5-5235-4541-9b45-6efdacc62d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344254b5-5235-4541-9b45-6efdacc62d81', 'volume_size': 1} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:30 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.info" returned: 0 in 0.254s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368066241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344254b5-5235-4541-9b45-6efdacc62d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:30Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Creating volume 344254b5-5235-4541-9b45-6efdacc62d81 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:30 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 1073741824 Nov 06 21:37:30 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d02eab98-78c0-4b16-b6b1-92f7c6e0c346 tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-6aad31dd-3e72-4c9d-ae2f-22f7e2859a41-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-6aad31dd-3e72-4c9d-ae2f-22f7e2859a41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-bf94f00a-faf6-4944-8420-113a7b79b61f" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-bf94f00a-faf6-4944-8420-113a7b79b61f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot 6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 of volume bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[826415e6-361a-4936-a4cc-5bdc0ec3b7f5]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 Nov 06 21:37:30 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:30 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 1073741824" returned: 0 in 0.430s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:30 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:30 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 Nov 06 21:37:30 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" returned: 0 in 0.402s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf94f00a-faf6-4944-8420-113a7b79b61f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1b27c7-7b92-4e60-bab7-377fb13d9cb6]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81" returned: 0 in 0.274s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c1c1bc-278b-4103-9658-f5e5b4eb1d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344254b5-5235-4541-9b45-6efdacc62d81', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce29de8d-92a1-4cfe-acc3-55fea1bd1d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:31 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Volume volume-344254b5-5235-4541-9b45-6efdacc62d81 (344254b5-5235-4541-9b45-6efdacc62d81): created successfully Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce29de8d-92a1-4cfe-acc3-55fea1bd1d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:31 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f Nov 06 21:37:31 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (ad56e429-7b60-4b8f-8282-a3ac0a4df3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:31 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-8d41baa5-f704-4f48-99af-3a15467ecdda tempest-ProjectReaderTests-1875426540 None] Created volume successfully. Nov 06 21:37:31 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f" returned: 0 in 0.387s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 Nov 06 21:37:31 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:31 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" returned: 0 in 0.323s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:31 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:31 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41 Nov 06 21:37:31 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f.6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" returned: 0 in 0.252s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-6aad31dd-3e72-4c9d-ae2f-22f7e2859a41" released by "_delete_snapshot" :: held 1.462s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-bf94f00a-faf6-4944-8420-113a7b79b61f" released by "delete_snapshot" :: held 1.486s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Created reservations ['4fb27ed9-a6ba-4522-9feb-41a8284e4ac5', '3ad1af67-114f-4920-8b49-d79a5a6094a1', 'bd4adbfc-43c0-4027-9196-e70e462fbe45', 'f56648d1-34ab-4c6f-b50e-3e398906f906'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d924350f-d2f0-42b0-9b97-2c84b5ff7df5 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-6aad31dd-3e72-4c9d-ae2f-22f7e2859a41-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:32 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:32 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-344254b5-5235-4541-9b45-6efdacc62d81-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-344254b5-5235-4541-9b45-6efdacc62d81-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-quobyte-344254b5-5235-4541-9b45-6efdacc62d81" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-344254b5-5235-4541-9b45-6efdacc62d81" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:32 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager._thread_info {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread count: 29 {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5544}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] thread info: [<_MainThread(MainThread, started 130218583736448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab962025-7e34-4287-84b9-bc7221a956de]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 Nov 06 21:37:32 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-bf94f00a-faf6-4944-8420-113a7b79b61f-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-bf94f00a-faf6-4944-8420-113a7b79b61f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-bf94f00a-faf6-4944-8420-113a7b79b61f" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-bf94f00a-faf6-4944-8420-113a7b79b61f" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3580ae-ada4-4a79-ad84-5bca098be07c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81" returned: 0 in 0.379s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:32 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81 Nov 06 21:37:32 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:32 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f Nov 06 21:37:32 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-344254b5-5235-4541-9b45-6efdacc62d81" returned: 0 in 0.253s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-344254b5-5235-4541-9b45-6efdacc62d81" released by "delete_volume" :: held 0.678s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Created reservations ['473fac86-e505-42a5-9a42-74419f713dde', 'e364a03f-e85f-4a51-8fc0-d9fcc0532eda', '5921de28-dabd-4fe4-a129-3ae0c8a1d6ec', '2f1c1361-3bfd-4eb7-b06d-81a913f98b86'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:33 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f" returned: 0 in 0.376s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f Nov 06 21:37:33 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:33 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-bf94f00a-faf6-4944-8420-113a7b79b61f" returned: 0 in 0.275s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-bf94f00a-faf6-4944-8420-113a7b79b61f" released by "delete_volume" :: held 0.724s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:33 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.255s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Deleted volume successfully. Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-2a7e80ea-cd07-44db-9f03-54b51049ab15 tempest-ProjectReaderTests-1875426540 None] Lock "cinder-344254b5-5235-4541-9b45-6efdacc62d81-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Created reservations ['cb8c3b49-e348-439a-a3c0-4115564c4b12', 'dccd2b88-0d0d-43ec-b771-48ec40396508', 'ad784cef-ce22-423a-89ad-b08834e88d10', '10f0fe59-6e34-4be8-99e9-84363a173a86'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:33 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:33 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:33 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.284s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:33 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:37:33 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ebbd1444-04eb-4767-bee7-418489b4dd77 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-bf94f00a-faf6-4944-8420-113a7b79b61f-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (34315cae-a1f1-466a-8e8d-244399556346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79743d5b-c7b0-47f1-9dd3-ba58d3721a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79743d5b-c7b0-47f1-9dd3-ba58d3721a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131525389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8a7611-5742-423a-b65d-84865669eb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:34Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6652be91-50a7-4ce2-9738-4c2ff51e2704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6652be91-50a7-4ce2-9738-4c2ff51e2704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a1001d-2621-4209-9d37-d9c026960032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a1001d-2621-4209-9d37-d9c026960032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8a7611-5742-423a-b65d-84865669eb67', 'volume_name': 'volume-ae8a7611-5742-423a-b65d-84865669eb67', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ce1d7c-2645-4951-a401-faad77601a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ce1d7c-2645-4951-a401-faad77601a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b5ad85-a195-4097-9802-97901ae097e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Volume ae8a7611-5742-423a-b65d-84865669eb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8a7611-5742-423a-b65d-84865669eb67', 'volume_size': 1} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131525389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8a7611-5742-423a-b65d-84865669eb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:34Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Creating volume ae8a7611-5742-423a-b65d-84865669eb67 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:34 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 1073741824 Nov 06 21:37:34 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (97b13ebc-de18-49ea-b1bd-bdae9373bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d5d9c3-b0c6-4ae4-b2ee-f882189b0d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d5d9c3-b0c6-4ae4-b2ee-f882189b0d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024015573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d633531-9fed-46f5-9509-0b8c25bb8164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:34Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa1e690-a18d-432e-a353-5e95be1a28f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa1e690-a18d-432e-a353-5e95be1a28f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5d43b8-3ee1-4755-8630-ded611713e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5d43b8-3ee1-4755-8630-ded611713e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d633531-9fed-46f5-9509-0b8c25bb8164', 'volume_name': 'volume-0d633531-9fed-46f5-9509-0b8c25bb8164', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c85a023-e300-48a9-9502-4097faabcf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c85a023-e300-48a9-9502-4097faabcf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17451f4b-9d9e-4488-a7dc-1dbc5727de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Volume 0d633531-9fed-46f5-9509-0b8c25bb8164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d633531-9fed-46f5-9509-0b8c25bb8164', 'volume_size': 1} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:34 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 1073741824" returned: 0 in 0.432s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 Nov 06 21:37:34 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67" returned: 0 in 0.253s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024015573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d633531-9fed-46f5-9509-0b8c25bb8164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:34Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Creating volume 0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:34 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b5ad85-a195-4097-9802-97901ae097e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8a7611-5742-423a-b65d-84865669eb67', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 1073741824 Nov 06 21:37:34 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282546c2-cbc6-4782-bbbd-c4de5d601903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:34 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Volume volume-ae8a7611-5742-423a-b65d-84865669eb67 (ae8a7611-5742-423a-b65d-84865669eb67): created successfully Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282546c2-cbc6-4782-bbbd-c4de5d601903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:34 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (34315cae-a1f1-466a-8e8d-244399556346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-7bfd8e92-ef10-4611-b395-e0887aa9145f tempest-ProjectReaderTests-1875426540 None] Created volume successfully. Nov 06 21:37:35 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 1073741824" returned: 0 in 0.431s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:35 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 Nov 06 21:37:35 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:35 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164" returned: 0 in 0.232s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17451f4b-9d9e-4488-a7dc-1dbc5727de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d633531-9fed-46f5-9509-0b8c25bb8164', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d40c93c-e0c1-40a5-ab12-9cfe51803211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:35 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Volume volume-0d633531-9fed-46f5-9509-0b8c25bb8164 (0d633531-9fed-46f5-9509-0b8c25bb8164): created successfully Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d40c93c-e0c1-40a5-ab12-9cfe51803211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:35 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (97b13ebc-de18-49ea-b1bd-bdae9373bad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:35 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-65710dde-c1d8-43ae-bdee-30c1be7316a4 tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-ae8a7611-5742-423a-b65d-84865669eb67-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Lock "cinder-ae8a7611-5742-423a-b65d-84865669eb67-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-quobyte-ae8a7611-5742-423a-b65d-84865669eb67" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-ae8a7611-5742-423a-b65d-84865669eb67" acquired by "delete_volume" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7cdf4-93fc-44c2-b6a8-3d75f9033703]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 Nov 06 21:37:36 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot 018d259f-9119-4180-a834-29d51efac964 of volume 0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d59fb7-8dfb-4fd5-ad16-d642dcf6464c]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67" returned: 0 in 0.413s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:36 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67 Nov 06 21:37:36 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 Nov 06 21:37:36 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:36 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-ae8a7611-5742-423a-b65d-84865669eb67" returned: 0 in 0.245s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:36 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-ae8a7611-5742-423a-b65d-84865669eb67" released by "delete_volume" :: held 0.709s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Created reservations ['e1bf6449-b19a-43e2-ad61-36ef7d5ce13b', '1d63e5e3-4aa7-40af-9c17-dc58d11e05e5', 'fd5e1e98-cc68-41aa-9324-956c687744c1', '639a03ed-2f16-40b6-b2fb-2ae4e037ca79'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:37 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164" returned: 0 in 0.392s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 1G Nov 06 21:37:37 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:37 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.257s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:37 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Deleted volume successfully. Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d8d30445-ab29-47b4-9a80-ac2f8124450a tempest-ProjectReaderTests-1875426540 None] Lock "cinder-ae8a7611-5742-423a-b65d-84865669eb67-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:37 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 1G" returned: 0 in 0.457s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d633531-9fed-46f5-9509-0b8c25bb8164 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d633531-9fed-46f5-9509-0b8c25bb8164 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 Nov 06 21:37:37 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d633531-9fed-46f5-9509-0b8c25bb8164 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964" returned: 0 in 0.294s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:37 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 is being set with open permissions: ugo+rw Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:37 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 Nov 06 21:37:37 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (3f1eb90f-d4b6-4b50-b384-566659ef84ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ab1104-a603-4c86-a821-1639be156b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ab1104-a603-4c86-a821-1639be156b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539420589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19f7938-b5b9-46dc-93da-77cca4622774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:38Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee33db24-a7f4-4000-85c0-dc425bfc4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee33db24-a7f4-4000-85c0-dc425bfc4e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06f6953-2e9c-4aa0-a5af-3dd93d52b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06f6953-2e9c-4aa0-a5af-3dd93d52b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19f7938-b5b9-46dc-93da-77cca4622774', 'volume_name': 'volume-a19f7938-b5b9-46dc-93da-77cca4622774', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c74820-6170-456b-bcb2-d95ff3b3400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c74820-6170-456b-bcb2-d95ff3b3400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b985962a-7c89-40b1-9b63-652d4821e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:37 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Volume a19f7938-b5b9-46dc-93da-77cca4622774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19f7938-b5b9-46dc-93da-77cca4622774', 'volume_size': 1} Nov 06 21:37:37 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:38 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964" returned: 0 in 0.256s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info Nov 06 21:37:38 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info" returned: 0 in 0.252s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info is being set with open permissions: ugo+rw Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info Nov 06 21:37:38 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.info" returned: 0 in 0.252s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539420589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19f7938-b5b9-46dc-93da-77cca4622774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe4de78613840ff9d0a53b97eaa2741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:38Z,use_quota=True,user_id='0d5760e5e02249ac99049ddbabfaabb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Creating volume a19f7938-b5b9-46dc-93da-77cca4622774 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:38 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:38 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 1073741824 Nov 06 21:37:38 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:38 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-da4e3f6f-dd53-4a7e-94e7-5c304cedd0ac tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-018d259f-9119-4180-a834-29d51efac964-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-018d259f-9119-4180-a834-29d51efac964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-0d633531-9fed-46f5-9509-0b8c25bb8164" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-0d633531-9fed-46f5-9509-0b8c25bb8164" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-018d259f-9119-4180-a834-29d51efac964" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-018d259f-9119-4180-a834-29d51efac964" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot 018d259f-9119-4180-a834-29d51efac964 of volume 0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c289364-e7a2-49dc-b2c8-4e6cc67bbe7b]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:38 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 Nov 06 21:37:39 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 1073741824" returned: 0 in 0.452s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 Nov 06 21:37:39 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964" returned: 0 in 0.397s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d633531-9fed-46f5-9509-0b8c25bb8164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425d0e2-8b7a-46cb-9931-77b5f46144c8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774" returned: 0 in 0.261s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b985962a-7c89-40b1-9b63-652d4821e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19f7938-b5b9-46dc-93da-77cca4622774', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d057411f-b208-48ac-922b-12c9e831fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:39 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Volume volume-a19f7938-b5b9-46dc-93da-77cca4622774 (a19f7938-b5b9-46dc-93da-77cca4622774): created successfully Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d057411f-b208-48ac-922b-12c9e831fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:39 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 Nov 06 21:37:39 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Flow 'volume_create_manager' (3f1eb90f-d4b6-4b50-b384-566659ef84ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:39 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-bc7bae40-f27a-468b-a98d-d4f5acf00480 tempest-ProjectReaderTests-1875426540 None] Created volume successfully. Nov 06 21:37:39 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:39 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 Nov 06 21:37:39 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-a19f7938-b5b9-46dc-93da-77cca4622774-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:39 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Lock "cinder-a19f7938-b5b9-46dc-93da-77cca4622774-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Acquiring lock "cinder-quobyte-a19f7938-b5b9-46dc-93da-77cca4622774" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-a19f7938-b5b9-46dc-93da-77cca4622774" acquired by "delete_volume" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3dc45-839c-4a1f-963b-8731b80b4876]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964" returned: 0 in 0.395s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964 Nov 06 21:37:40 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 Nov 06 21:37:40 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164.018d259f-9119-4180-a834-29d51efac964" returned: 0 in 0.255s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-018d259f-9119-4180-a834-29d51efac964" released by "_delete_snapshot" :: held 1.511s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-0d633531-9fed-46f5-9509-0b8c25bb8164" released by "delete_snapshot" :: held 1.532s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Created reservations ['cbe7e54e-ca04-4ab4-b984-af5d49788523', 'd49d45ed-f0d0-4d77-83d2-10ea343b4322', '884ef70a-f83e-4611-a479-62829e10d566', '9bfb819b-8fbf-48dc-a557-d075a7521c54'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:40 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774" returned: 0 in 0.392s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774 Nov 06 21:37:40 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-647a1d2b-8477-4068-aa6e-ffa1d8b19a6a tempest-ProjectMemberTests-1707644949 None] Lock "cinder-018d259f-9119-4180-a834-29d51efac964-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:40 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-a19f7938-b5b9-46dc-93da-77cca4622774" returned: 0 in 0.250s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Lock "cinder-quobyte-a19f7938-b5b9-46dc-93da-77cca4622774" released by "delete_volume" :: held 0.685s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Created reservations ['b6cf7db2-619f-437e-aca9-ddbf34ed472c', '220a7720-9863-480b-ba78-7d63098a29a2', '819c15ae-8d35-4077-99fa-5ede14bf3aad', '64fd2720-1058-4203-bc37-55d9b56695f1'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:40 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:40 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:40 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-0d633531-9fed-46f5-9509-0b8c25bb8164-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-0d633531-9fed-46f5-9509-0b8c25bb8164-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-0d633531-9fed-46f5-9509-0b8c25bb8164" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:41 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.264s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-0d633531-9fed-46f5-9509-0b8c25bb8164" acquired by "delete_volume" :: waited 0.029s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:41 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Deleted volume successfully. Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e157b3-2418-43f7-b86f-07c728c8738a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-9ccddc43-7933-4c05-bd51-80ab9c057c4b tempest-ProjectReaderTests-1875426540 None] Lock "cinder-a19f7938-b5b9-46dc-93da-77cca4622774-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:41 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 Nov 06 21:37:41 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164" returned: 0 in 0.409s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:41 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164 Nov 06 21:37:41 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:41 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-0d633531-9fed-46f5-9509-0b8c25bb8164" returned: 0 in 0.262s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-0d633531-9fed-46f5-9509-0b8c25bb8164" released by "delete_volume" :: held 0.765s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:41 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Created reservations ['a8a5ecab-987f-4102-9410-1242c43079df', 'c2c37cd2-efa9-4328-b9fa-11ea91ac9231', '8b798fbb-9487-4ea2-b8e0-b713a2d647bf', '761a2e7e-0d97-4f85-8ee6-01e6341f069a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:42 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:42 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:42 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-1f614997-2819-4e31-9e41-2fcba85b3fa1 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-0d633531-9fed-46f5-9509-0b8c25bb8164-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (eb9b185f-28c2-4883-8e14-657e45268cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add2f0d9-7b5d-4e63-88a2-3350987ad2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add2f0d9-7b5d-4e63-88a2-3350987ad2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628562555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30280426-7bc9-4cf5-9134-afe262a3d9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:43Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b7ed7a-51a3-44b2-9535-88243f068eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b7ed7a-51a3-44b2-9535-88243f068eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ba88f-356a-4477-bea8-f6e6a65fc49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ba88f-356a-4477-bea8-f6e6a65fc49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30280426-7bc9-4cf5-9134-afe262a3d9e1', 'volume_name': 'volume-30280426-7bc9-4cf5-9134-afe262a3d9e1', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e8480-3567-4ee5-bd85-4f1d9f2995f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e8480-3567-4ee5-bd85-4f1d9f2995f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1303a7-a4ff-4824-9318-dbf0055abec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:42 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Volume 30280426-7bc9-4cf5-9134-afe262a3d9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30280426-7bc9-4cf5-9134-afe262a3d9e1', 'volume_size': 1} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628562555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30280426-7bc9-4cf5-9134-afe262a3d9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:43Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Creating volume 30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:42 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:42 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:42 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 1073741824 Nov 06 21:37:42 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 1073741824" returned: 0 in 0.434s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:43 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 Nov 06 21:37:43 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:43 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1" returned: 0 in 0.246s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1303a7-a4ff-4824-9318-dbf0055abec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30280426-7bc9-4cf5-9134-afe262a3d9e1', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a3e24-cc40-4370-ba9d-49eb3fe6ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:43 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Volume volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 (30280426-7bc9-4cf5-9134-afe262a3d9e1): created successfully Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a3e24-cc40-4370-ba9d-49eb3fe6ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (eb9b185f-28c2-4883-8e14-657e45268cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:43 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-4b4e0e2f-24cb-4ca4-84a0-ce4d52c6c094 tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot 1f4261d0-067a-433c-9507-ec5e03a58810 of volume 30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e5665-ea0b-4ae9-ae63-abc2ec16cf40]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:43 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:43 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 Nov 06 21:37:44 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:44 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1" returned: 0 in 0.370s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 1G Nov 06 21:37:44 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:44 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 1G" returned: 0 in 0.384s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 Nov 06 21:37:44 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:44 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810" returned: 0 in 0.292s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:44 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 is being set with open permissions: ugo+rw Nov 06 21:37:44 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:44 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 Nov 06 21:37:44 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810" returned: 0 in 0.250s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:45 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info Nov 06 21:37:45 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info" returned: 0 in 0.241s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info is being set with open permissions: ugo+rw Nov 06 21:37:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:45 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info Nov 06 21:37:45 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:45 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.info" returned: 0 in 0.260s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:45 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:45 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c64f0ef9-cfce-496d-ac30-911eba3cd804 tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-1f4261d0-067a-433c-9507-ec5e03a58810-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-1f4261d0-067a-433c-9507-ec5e03a58810-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-30280426-7bc9-4cf5-9134-afe262a3d9e1" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-30280426-7bc9-4cf5-9134-afe262a3d9e1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-1f4261d0-067a-433c-9507-ec5e03a58810" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-1f4261d0-067a-433c-9507-ec5e03a58810" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot 1f4261d0-067a-433c-9507-ec5e03a58810 of volume 30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[852429fc-ce12-480e-82de-d5a89aa6bcf1]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 Nov 06 21:37:46 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:46 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810" returned: 0 in 0.389s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30280426-7bc9-4cf5-9134-afe262a3d9e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e90149-158c-4d7b-ba34-c4e604d8223a]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 Nov 06 21:37:46 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:46 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1" returned: 0 in 0.360s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:46 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:46 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 Nov 06 21:37:46 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:47 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:47 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810 Nov 06 21:37:47 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:47 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1.1f4261d0-067a-433c-9507-ec5e03a58810" returned: 0 in 0.234s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-1f4261d0-067a-433c-9507-ec5e03a58810" released by "_delete_snapshot" :: held 1.438s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-30280426-7bc9-4cf5-9134-afe262a3d9e1" released by "delete_snapshot" :: held 1.458s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Created reservations ['34860645-b27f-412d-b9a1-9634603596f7', 'c500a7b6-f1b4-4192-b523-d62672c6cb3b', '88338da1-2cf7-445a-9fcc-2e77b9a88ec2', 'cf109c8b-03aa-4deb-b842-184d72e4e0a9'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:47 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:37:47 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-a67ffda6-767e-488e-85c2-be971edde433 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-1f4261d0-067a-433c-9507-ec5e03a58810-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-30280426-7bc9-4cf5-9134-afe262a3d9e1-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-30280426-7bc9-4cf5-9134-afe262a3d9e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-30280426-7bc9-4cf5-9134-afe262a3d9e1" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-30280426-7bc9-4cf5-9134-afe262a3d9e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c36b77-4e16-4f1e-8b88-d3079cdedab7]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 Nov 06 21:37:48 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1" returned: 0 in 0.360s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:48 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1 Nov 06 21:37:48 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:48 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-30280426-7bc9-4cf5-9134-afe262a3d9e1" returned: 0 in 0.263s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-30280426-7bc9-4cf5-9134-afe262a3d9e1" released by "delete_volume" :: held 0.691s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:48 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Created reservations ['14dc0d43-01dc-4157-8e0e-897b955f1669', '9feaacd9-048e-4c07-841a-fd8f7cb4e8a0', '1639eba2-b519-4ab6-9ed2-1cf8333386a2', 'dafc6f07-95c9-4d57-991f-2e787e3d2a6a'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:49 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:49 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:49 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.267s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:49 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-f7c38c09-a1b9-4297-b21b-4ba3945701c0 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-30280426-7bc9-4cf5-9134-afe262a3d9e1-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (ba8390a3-92e6-4d29-9057-aebfa9c9fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643dfd7d-dfb5-4dea-ae2d-a3f0ea38a49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643dfd7d-dfb5-4dea-ae2d-a3f0ea38a49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376264042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed5e3e1-5d43-4a0e-9483-886b38175f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:50Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8f6ea4-5dba-4adc-9a24-49c8e4daa084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8f6ea4-5dba-4adc-9a24-49c8e4daa084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6150218c-1153-404f-acaa-9a141f2cc26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6150218c-1153-404f-acaa-9a141f2cc26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed5e3e1-5d43-4a0e-9483-886b38175f96', 'volume_name': 'volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbb7635-8dc5-4c6c-ac2e-6f8775cfc337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbb7635-8dc5-4c6c-ac2e-6f8775cfc337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b10eda-c7f5-4412-b438-85869ca4d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:49 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Volume 4ed5e3e1-5d43-4a0e-9483-886b38175f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96', 'volume_size': 1} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1376264042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed5e3e1-5d43-4a0e-9483-886b38175f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b01252803e846ccb3fc87abca9abfdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:37:50Z,use_quota=True,user_id='931490303bf944f6811b6abc2bc6b3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Creating volume 4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:37:49 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:37:49 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:49 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 1073741824 Nov 06 21:37:49 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:50 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 1073741824" returned: 0 in 0.430s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:50 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 Nov 06 21:37:50 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:50 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96" returned: 0 in 0.244s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b10eda-c7f5-4412-b438-85869ca4d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80aa271-8c9a-47eb-9765-8cd331172252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:37:50 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Volume volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 (4ed5e3e1-5d43-4a0e-9483-886b38175f96): created successfully Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80aa271-8c9a-47eb-9765-8cd331172252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Flow 'volume_create_manager' (ba8390a3-92e6-4d29-9057-aebfa9c9fe16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:37:50 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-2893df45-e918-4f14-a62c-c8dc800abb0a tempest-ProjectMemberTests-1707644949 None] Created volume successfully. Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Creating offline snapshot df06bffd-2633-4617-b350-0bab5bf172e4 of volume 4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dd6464-b74a-4fec-b25b-c03e5a756c92]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:50 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:51 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 Nov 06 21:37:51 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:51 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96" returned: 0 in 0.377s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 1G {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:51 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 1G Nov 06 21:37:51 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:51 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 1G" returned: 0 in 0.405s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:51 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:51 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 Nov 06 21:37:51 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 -F qcow2 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4" returned: 0 in 0.298s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 is being set with open permissions: ugo+rw Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 Nov 06 21:37:52 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4" returned: 0 in 0.261s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info Nov 06 21:37:52 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info" returned: 0 in 0.265s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87350]: WARNING cinder.volume.drivers.remotefs [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info is being set with open permissions: ugo+rw Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:52 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info Nov 06 21:37:52 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:52 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.info" returned: 0 in 0.259s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:52 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:52 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-b49e0201-6836-42b1-8e0a-c2da2061900e tempest-ProjectMemberTests-1707644949 None] Create snapshot completed successfully Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-df06bffd-2633-4617-b350-0bab5bf172e4-delete_snapshot" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-df06bffd-2633-4617-b350-0bab5bf172e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-4ed5e3e1-5d43-4a0e-9483-886b38175f96" by "delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-4ed5e3e1-5d43-4a0e-9483-886b38175f96" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-df06bffd-2633-4617-b350-0bab5bf172e4" by "_delete_snapshot" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-df06bffd-2633-4617-b350-0bab5bf172e4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Deleting offline snapshot df06bffd-2633-4617-b350-0bab5bf172e4 of volume 4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] snapshot_file for this snap is: volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 {{(pid=87350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19736cd-6365-4922-8e5d-74f1dae0ff87]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:53 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 Nov 06 21:37:53 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:53 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4" returned: 0 in 0.369s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1182dcc-fdad-42cb-b5a7-3c24c08bb4ea]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:53 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:53 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 Nov 06 21:37:53 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:54 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96" returned: 0 in 0.371s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:54 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 Nov 06 21:37:54 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:54 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4" returned: 0 in 0.351s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:54 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4 Nov 06 21:37:54 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:54 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96.df06bffd-2633-4617-b350-0bab5bf172e4" returned: 0 in 0.253s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-df06bffd-2633-4617-b350-0bab5bf172e4" released by "_delete_snapshot" :: held 1.446s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-4ed5e3e1-5d43-4a0e-9483-886b38175f96" released by "delete_snapshot" :: held 1.470s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Created reservations ['921f5b3b-400b-480a-b5c8-b7e520323b94', '3a656fe4-f2c0-4f2c-b569-60d2c712a444', '033dfbf2-6afa-4a0f-b0f2-2a35d4d650d1', 'ec8bae19-2c5a-4a8e-b77a-6c17b4490100'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:54 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Delete snapshot completed successfully. Nov 06 21:37:54 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-ae5ba76c-4dfe-46c8-ace8-c4c8b1938d06 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-df06bffd-2633-4617-b350-0bab5bf172e4-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-4ed5e3e1-5d43-4a0e-9483-886b38175f96-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-4ed5e3e1-5d43-4a0e-9483-886b38175f96-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "cinder-quobyte-4ed5e3e1-5d43-4a0e-9483-886b38175f96" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-4ed5e3e1-5d43-4a0e-9483-886b38175f96" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a7abb9-1467-4767-949d-2f8e76c24f0f]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 Nov 06 21:37:55 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:55 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96" returned: 0 in 0.357s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:55 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:55 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96 Nov 06 21:37:55 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-4ed5e3e1-5d43-4a0e-9483-886b38175f96" returned: 0 in 0.254s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-quobyte-4ed5e3e1-5d43-4a0e-9483-886b38175f96" released by "delete_volume" :: held 0.676s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Created reservations ['ed0194b2-ecfc-454d-ba09-525a6b29f9d1', '5f892381-8fdf-4c2c-87da-3e766a1aedbc', '5ce68c45-d92e-4cb6-9d26-c8bd98287b44', '755663b5-f106-4532-b83b-01af656170d0'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:56 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:37:56 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:56 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.258s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:56 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Deleted volume successfully. Nov 06 21:37:56 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-e624c2ad-32ab-4009-901d-647971f74996 tempest-ProjectMemberTests-1707644949 None] Lock "cinder-4ed5e3e1-5d43-4a0e-9483-886b38175f96-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:06 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:INSERT=29,cinder:UPDATE=121,cinder:SELECT=98,cinder:DELETE=11 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:06 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=87,cinder:INSERT=39,cinder:UPDATE=138,cinder:DELETE=10 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:08 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Flow 'volume_create_manager' (45839de5-16d9-418d-a84e-a30446e0eb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923b5e39-9166-4142-a3ce-d8b5382c4c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923b5e39-9166-4142-a3ce-d8b5382c4c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1405257789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f0bb0f-b7f2-4b9c-82f3-82fde54c3828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543946e878ea44778db9b26e62738e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:09Z,use_quota=True,user_id='48e64b53c87f4ecda23b4bde900eb79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b74f19c-c8ea-4d9e-8309-da9dc5e51c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b74f19c-c8ea-4d9e-8309-da9dc5e51c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3d745d-dc03-4fd9-8460-47feb80673a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3d745d-dc03-4fd9-8460-47feb80673a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f0bb0f-b7f2-4b9c-82f3-82fde54c3828', 'volume_name': 'volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa83281b-6e1a-4f2b-9a29-0ead2a6db9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa83281b-6e1a-4f2b-9a29-0ead2a6db9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e2d5a-c8aa-4ccb-a009-84735369cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:09 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Volume 52f0bb0f-b7f2-4b9c-82f3-82fde54c3828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828', 'volume_size': 1} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1405257789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f0bb0f-b7f2-4b9c-82f3-82fde54c3828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543946e878ea44778db9b26e62738e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:09Z,use_quota=True,user_id='48e64b53c87f4ecda23b4bde900eb79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Creating volume 52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:09 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:09 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 1073741824 Nov 06 21:38:09 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:09 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 1073741824" returned: 0 in 0.456s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:09 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 Nov 06 21:38:09 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:09 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828" returned: 0 in 0.240s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16e2d5a-c8aa-4ccb-a009-84735369cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80318d37-a3e5-47cf-af25-7d1976742917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:09 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Volume volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 (52f0bb0f-b7f2-4b9c-82f3-82fde54c3828): created successfully Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80318d37-a3e5-47cf-af25-7d1976742917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:09 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Flow 'volume_create_manager' (45839de5-16d9-418d-a84e-a30446e0eb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:09 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-1238159a-1297-4bdd-97cb-19c9d1a1496c tempest-ProjectReaderTests-727603932 None] Created volume successfully. Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Acquiring lock "cinder-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Lock "cinder-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Acquiring lock "cinder-quobyte-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Lock "cinder-quobyte-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828" acquired by "delete_volume" :: waited 0.015s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5e96a-5d73-4391-82d0-cd9b1debe44e]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 Nov 06 21:38:10 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:10 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828" returned: 0 in 0.349s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828 Nov 06 21:38:10 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:10 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828" returned: 0 in 0.235s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Lock "cinder-quobyte-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828" released by "delete_volume" :: held 0.630s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Created reservations ['65280f74-4851-4a64-80d5-d3bcf49b8130', 'b519baf7-ab31-415a-87ae-4966cc74dd3f', '081a79ef-dbce-42be-a87a-1ac8d2267da9', 'cf45d933-f74b-4a14-85da-90cc77abc802'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:10 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:10 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:38:10 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:11 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.238s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:11 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Deleted volume successfully. Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-d2032e4d-b887-485a-957c-0bb442d8d0cd tempest-ProjectReaderTests-727603932 None] Lock "cinder-52f0bb0f-b7f2-4b9c-82f3-82fde54c3828-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1404}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Flow 'volume_create_manager' (09237dc7-4883-4696-a70f-cabf1cdf879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60a46b6-5c2f-497d-a604-a140787f9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60a46b6-5c2f-497d-a604-a140787f9e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977044464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2c204b-f426-40c6-9a2e-67be814f3897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543946e878ea44778db9b26e62738e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:12Z,use_quota=True,user_id='48e64b53c87f4ecda23b4bde900eb79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168009ab-e147-4162-87ee-5bf4e9428f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168009ab-e147-4162-87ee-5bf4e9428f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc84889-d88b-44a1-a9da-94aa557dc85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc84889-d88b-44a1-a9da-94aa557dc85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2c204b-f426-40c6-9a2e-67be814f3897', 'volume_name': 'volume-df2c204b-f426-40c6-9a2e-67be814f3897', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acde60bc-7468-4b8a-a70a-59c4e4d0f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acde60bc-7468-4b8a-a70a-59c4e4d0f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3536a167-c162-4db1-ae39-400c9cb3d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:11 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Volume df2c204b-f426-40c6-9a2e-67be814f3897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2c204b-f426-40c6-9a2e-67be814f3897', 'volume_size': 1} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977044464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2c204b-f426-40c6-9a2e-67be814f3897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543946e878ea44778db9b26e62738e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:12Z,use_quota=True,user_id='48e64b53c87f4ecda23b4bde900eb79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(134d40b5-5371-4acb-9324-aa2c502c74a8),volume_type_id=134d40b5-5371-4acb-9324-aa2c502c74a8)}" {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.remotefs [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Creating volume df2c204b-f426-40c6-9a2e-67be814f3897 {{(pid=87350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Selected osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f as target Quobyte volume. {{(pid=87350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:11 devstack cinder-volume[87350]: INFO cinder.volume.drivers.remotefs [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] casted to osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f Nov 06 21:38:11 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 1073741824 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:11 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 1073741824 Nov 06 21:38:11 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:12 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 1073741824" returned: 0 in 0.426s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:12 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 Nov 06 21:38:12 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:12 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897" returned: 0 in 0.285s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'} {{(pid=87350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3536a167-c162-4db1-ae39-400c9cb3d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2c204b-f426-40c6-9a2e-67be814f3897', 'volume_size': 1}' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a107b3dc-3c58-4eee-91d4-1f4b393b4def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:12 devstack cinder-volume[87350]: INFO cinder.volume.flows.manager.create_volume [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Volume volume-df2c204b-f426-40c6-9a2e-67be814f3897 (df2c204b-f426-40c6-9a2e-67be814f3897): created successfully Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a107b3dc-3c58-4eee-91d4-1f4b393b4def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Flow 'volume_create_manager' (09237dc7-4883-4696-a70f-cabf1cdf879c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:12 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-f50df31b-706d-46a9-acc0-d0b1b04b4fcd tempest-ProjectReaderTests-727603932 None] Created volume successfully. Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Acquiring lock "cinder-df2c204b-f426-40c6-9a2e-67be814f3897-delete_volume" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Lock "cinder-df2c204b-f426-40c6-9a2e-67be814f3897-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Acquiring lock "cinder-quobyte-df2c204b-f426-40c6-9a2e-67be814f3897" by "delete_volume" {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Lock "cinder-quobyte-df2c204b-f426-40c6-9a2e-67be814f3897" acquired by "delete_volume" :: waited 0.017s {{(pid=87350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG oslo.privsep.daemon [-] privsep: reply[045eb435-9ecc-49ef-b56b-71da6cc43aa8]: (4, 'qcow2') {{(pid=89117) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:12 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:13 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 Nov 06 21:38:13 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:13 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897" returned: 0 in 0.354s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:13 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897 Nov 06 21:38:13 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:13 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c/volume-df2c204b-f426-40c6-9a2e-67be814f3897" returned: 0 in 0.274s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Lock "cinder-quobyte-df2c204b-f426-40c6-9a2e-67be814f3897" released by "delete_volume" :: held 0.672s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG cinder.quota [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Created reservations ['d13edfbd-bbe4-4c55-973a-a14ddd36f6ae', '63b00d62-9be2-4898-9375-7b4fba1725ca', 'adb482a8-14d2-4261-97ed-30ad49c932ea', '8cf7e5b9-e38b-4919-84fb-051e401ba2d4'] {{(pid=87350) reserve /opt/stack/cinder/cinder/quota.py:842}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:13 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:13 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:38:13 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:14 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:14 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c" returned: 0 in 0.291s {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:14 devstack cinder-volume[87350]: DEBUG cinder.manager [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Notifying Schedulers of capabilities ... {{(pid=87350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:14 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Deleted volume successfully. Nov 06 21:38:14 devstack cinder-volume[87350]: DEBUG cinder.coordination [None req-c56f5744-8ca1-4f79-bfa9-7aa25aa4b352 tempest-ProjectReaderTests-727603932 None] Lock "cinder-df2c204b-f426-40c6-9a2e-67be814f3897-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87350) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=14,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG oslo_service.periodic_task [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f': None} {{(pid=87350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG cinder.volume.drivers.quobyte [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ed6da466-0737-43bf-9ca9-feb5a953244f'] {{(pid=87350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:32 devstack cinder-volume[87350]: DEBUG oslo_concurrency.processutils [None req-db37c9ad-6ba1-46de-8448-ff58168a0ee8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c {{(pid=87350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:32 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab0383bbc12fe951240510533407441c Nov 06 21:38:32 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)